Max level shown:
12025-06-04T15:45:02.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bfab38e1-ed1e-47d5-bddf-529533ba80ea roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22025-06-04T15:45:02.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bfab38e1-ed1e-47d5-bddf-529533ba80ea resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
32025-06-04T15:45:02.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bfab38e1-ed1e-47d5-bddf-529533ba80ea response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
42025-06-04T15:45:03.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 1d31751e-b5c7-45ab-af2d-92f0c35f9d58 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52025-06-04T15:45:03.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 1d31751e-b5c7-45ab-af2d-92f0c35f9d58 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
62025-06-04T15:45:03.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 1d31751e-b5c7-45ab-af2d-92f0c35f9d58 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
72025-06-04T15:45:04.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6cd3cffb-ad1d-46f5-adc0-7958a1ae6154 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
82025-06-04T15:45:04.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6cd3cffb-ad1d-46f5-adc0-7958a1ae6154 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
92025-06-04T15:45:04.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6cd3cffb-ad1d-46f5-adc0-7958a1ae6154 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
102025-06-04T15:45:05.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a54c8ed8-ed91-4885-879a-9337803df36c roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
112025-06-04T15:45:05.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a54c8ed8-ed91-4885-879a-9337803df36c resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
122025-06-04T15:45:05.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a54c8ed8-ed91-4885-879a-9337803df36c response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
132025-06-04T15:45:06.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6449a2dc-f4f0-4388-83cf-fada81a22161 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
142025-06-04T15:45:06.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6449a2dc-f4f0-4388-83cf-fada81a22161 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
152025-06-04T15:45:06.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2513 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6449a2dc-f4f0-4388-83cf-fada81a22161 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
162025-06-04T15:45:07.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 16ef7ac6-d2a1-4f2a-ab55-cb04534007b4 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
172025-06-04T15:45:07.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 16ef7ac6-d2a1-4f2a-ab55-cb04534007b4 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
182025-06-04T15:45:07.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 16ef7ac6-d2a1-4f2a-ab55-cb04534007b4 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
192025-06-04T15:45:08.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = cd55021f-d3a9-47e5-b955-f197775204ef roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
202025-06-04T15:45:08.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = cd55021f-d3a9-47e5-b955-f197775204ef resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
212025-06-04T15:45:08.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2456 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = cd55021f-d3a9-47e5-b955-f197775204ef response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
222025-06-04T15:45:09.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 86e78ab9-a4df-4d41-82cc-0ee150ad9049 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
232025-06-04T15:45:09.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 86e78ab9-a4df-4d41-82cc-0ee150ad9049 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
242025-06-04T15:45:09.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1823 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 86e78ab9-a4df-4d41-82cc-0ee150ad9049 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
252025-06-04T15:45:09.948ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 544 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = dca5f924-03b1-4759-b6c6-76760d2eca14 response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
262025-06-04T15:45:10.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8db9371c-3a7a-4958-8840-cc17f558d288 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
272025-06-04T15:45:10.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8db9371c-3a7a-4958-8840-cc17f558d288 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
282025-06-04T15:45:10.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8db9371c-3a7a-4958-8840-cc17f558d288 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
292025-06-04T15:45:11.747ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
302025-06-04T15:45:11.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
312025-06-04T15:45:11.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
322025-06-04T15:45:11.747ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
332025-06-04T15:45:11.747ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
342025-06-04T15:45:11.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
352025-06-04T15:45:11.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
362025-06-04T15:45:11.750ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
372025-06-04T15:45:11.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
382025-06-04T15:45:11.752ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.483406ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
392025-06-04T15:45:11.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
402025-06-04T15:45:11.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
412025-06-04T15:45:11.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
422025-06-04T15:45:11.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
432025-06-04T15:45:11.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
442025-06-04T15:45:11.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
452025-06-04T15:45:11.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
462025-06-04T15:45:11.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
472025-06-04T15:45:11.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
482025-06-04T15:45:11.766ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
492025-06-04T15:45:11.766ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.148855ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
502025-06-04T15:45:11.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ef41fde4-7803-4814-9515-691a2b483998 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
512025-06-04T15:45:11.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ef41fde4-7803-4814-9515-691a2b483998 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
522025-06-04T15:45:11.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1900 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ef41fde4-7803-4814-9515-691a2b483998 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
532025-06-04T15:45:12.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d8057fec-011e-4573-a9cb-6977a2ea66cb roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
542025-06-04T15:45:12.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d8057fec-011e-4573-a9cb-6977a2ea66cb resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
552025-06-04T15:45:12.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d8057fec-011e-4573-a9cb-6977a2ea66cb response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
562025-06-04T15:45:13.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 546f9a52-1eab-49f5-a044-52eda9774efd roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
572025-06-04T15:45:13.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 546f9a52-1eab-49f5-a044-52eda9774efd resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
582025-06-04T15:45:13.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1908 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 546f9a52-1eab-49f5-a044-52eda9774efd response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
592025-06-04T15:45:14.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 229d15ac-6a6b-430c-b4c4-5204b95c6ff9 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
602025-06-04T15:45:14.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 229d15ac-6a6b-430c-b4c4-5204b95c6ff9 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
612025-06-04T15:45:14.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 229d15ac-6a6b-430c-b4c4-5204b95c6ff9 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
622025-06-04T15:45:15.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 70c5c01a-64f8-45b4-b01f-fc375a69d25f roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
632025-06-04T15:45:15.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 70c5c01a-64f8-45b4-b01f-fc375a69d25f resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
642025-06-04T15:45:15.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 70c5c01a-64f8-45b4-b01f-fc375a69d25f response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
652025-06-04T15:45:16.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = dc748434-2b1a-4093-9969-bd44d87df97d roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
662025-06-04T15:45:16.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = dc748434-2b1a-4093-9969-bd44d87df97d resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
672025-06-04T15:45:16.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = dc748434-2b1a-4093-9969-bd44d87df97d response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
682025-06-04T15:45:17.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3f0067cc-f30f-4240-8cbc-c7188e90b082 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
692025-06-04T15:45:17.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3f0067cc-f30f-4240-8cbc-c7188e90b082 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
702025-06-04T15:45:17.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3f0067cc-f30f-4240-8cbc-c7188e90b082 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
712025-06-04T15:45:18.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = afb9378f-ec5b-41bc-8d0f-72baf1047a5e roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
722025-06-04T15:45:18.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = afb9378f-ec5b-41bc-8d0f-72baf1047a5e resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
732025-06-04T15:45:18.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1901 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = afb9378f-ec5b-41bc-8d0f-72baf1047a5e response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
742025-06-04T15:45:19.948ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 458 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = 7c4696fa-1c63-4991-a5fb-8f57382ca4e5 response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
752025-06-04T15:45:20.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 51ef79ec-0732-46b2-9556-488d20907b6e roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
762025-06-04T15:45:20.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 51ef79ec-0732-46b2-9556-488d20907b6e resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
772025-06-04T15:45:20.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1743 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 51ef79ec-0732-46b2-9556-488d20907b6e response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
782025-06-04T15:45:21.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4f3de9ee-2f63-4788-a511-9d538d9f2ea6 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
792025-06-04T15:45:21.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4f3de9ee-2f63-4788-a511-9d538d9f2ea6 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
802025-06-04T15:45:21.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2449 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4f3de9ee-2f63-4788-a511-9d538d9f2ea6 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
812025-06-04T15:45:21.745ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
822025-06-04T15:45:21.745ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
832025-06-04T15:45:21.745ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
842025-06-04T15:45:21.745ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
852025-06-04T15:45:21.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
862025-06-04T15:45:21.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
872025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
882025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
892025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
902025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
912025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
922025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 20 reason = Timeout
932025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
942025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
952025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
962025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
972025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
982025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
992025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1002025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1012025-06-04T15:45:21.747ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1889, tv_nsec: 889924924 } })
1022025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1032025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1042025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
1052025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1062025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
1072025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1082025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
1092025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1102025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1112025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
1122025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1132025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
1142025-06-04T15:45:21.747ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1152025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1162025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
1172025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1182025-06-04T15:45:21.747ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
1192025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1202025-06-04T15:45:21.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1212025-06-04T15:45:21.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1222025-06-04T15:45:21.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1232025-06-04T15:45:21.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1242025-06-04T15:45:21.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1252025-06-04T15:45:21.748ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1889, tv_nsec: 891416093 } })
1262025-06-04T15:45:21.749ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
1272025-06-04T15:45:21.749ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1282025-06-04T15:45:21.749ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1292025-06-04T15:45:21.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1302025-06-04T15:45:21.750ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1312025-06-04T15:45:21.751ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1322025-06-04T15:45:21.751ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.381534ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1332025-06-04T15:45:21.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1342025-06-04T15:45:21.753ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1352025-06-04T15:45:21.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1362025-06-04T15:45:21.753ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1372025-06-04T15:45:21.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1382025-06-04T15:45:21.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1392025-06-04T15:45:21.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
1402025-06-04T15:45:21.754ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1412025-06-04T15:45:21.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1422025-06-04T15:45:21.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1432025-06-04T15:45:21.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1442025-06-04T15:45:21.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1452025-06-04T15:45:21.755ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1462025-06-04T15:45:21.755ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1472025-06-04T15:45:21.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1482025-06-04T15:45:21.756ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
1492025-06-04T15:45:21.756ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1502025-06-04T15:45:21.756ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
1512025-06-04T15:45:21.756ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
1522025-06-04T15:45:21.756ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1532025-06-04T15:45:21.756ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1542025-06-04T15:45:21.756ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
1552025-06-04T15:45:21.756ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1562025-06-04T15:45:21.756ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1572025-06-04T15:45:21.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1582025-06-04T15:45:21.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1592025-06-04T15:45:21.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1602025-06-04T15:45:21.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1612025-06-04T15:45:21.757ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1622025-06-04T15:45:21.758ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1632025-06-04T15:45:21.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1642025-06-04T15:45:21.759ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1889, tv_nsec: 901790470 } })
1652025-06-04T15:45:21.759ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
1662025-06-04T15:45:21.759ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1672025-06-04T15:45:21.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1682025-06-04T15:45:21.759ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1692025-06-04T15:45:21.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1702025-06-04T15:45:21.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1712025-06-04T15:45:21.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1722025-06-04T15:45:21.759ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 20 reason = Timeout
1732025-06-04T15:45:21.759ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
1742025-06-04T15:45:21.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
1752025-06-04T15:45:21.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1762025-06-04T15:45:21.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1772025-06-04T15:45:21.762ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1782025-06-04T15:45:21.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1792025-06-04T15:45:21.767ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1802025-06-04T15:45:21.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1812025-06-04T15:45:21.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 45.867824ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
1822025-06-04T15:45:21.804ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1832025-06-04T15:45:21.804ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1842025-06-04T15:45:21.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1852025-06-04T15:45:21.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1862025-06-04T15:45:21.806ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1872025-06-04T15:45:21.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1882025-06-04T15:45:21.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1892025-06-04T15:45:21.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1902025-06-04T15:45:21.807ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1912025-06-04T15:45:21.807ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1922025-06-04T15:45:21.807ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
1932025-06-04T15:45:21.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1942025-06-04T15:45:21.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1952025-06-04T15:45:21.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1962025-06-04T15:45:21.808ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.214103ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1972025-06-04T15:45:21.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1982025-06-04T15:45:21.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1992025-06-04T15:45:21.810ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.948453ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
2002025-06-04T15:45:21.811ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2012025-06-04T15:45:21.812ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2022025-06-04T15:45:21.812ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 64.960619ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2032025-06-04T15:45:21.812ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 52.788258ms iteration = 20 status = {"errors":[],"requests_created_ok":[]}
2042025-06-04T15:45:21.812ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2052025-06-04T15:45:21.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2062025-06-04T15:45:21.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e751cd2d-7b1b-4ea0-8b5a-62525772a5f5, lookup_type: ById(e751cd2d-7b1b-4ea0-8b5a-62525772a5f5) } result = Ok(())
2072025-06-04T15:45:21.814ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2082025-06-04T15:45:21.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2092025-06-04T15:45:21.815ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2102025-06-04T15:45:21.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2112025-06-04T15:45:21.816ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 69.11683ms iteration = 20 status = 0
2122025-06-04T15:45:21.816ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2132025-06-04T15:45:21.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2142025-06-04T15:45:21.818ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2152025-06-04T15:45:21.818ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2162025-06-04T15:45:21.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2172025-06-04T15:45:21.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2182025-06-04T15:45:21.820ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2192025-06-04T15:45:21.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2202025-06-04T15:45:21.821ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2212025-06-04T15:45:21.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2222025-06-04T15:45:21.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
2232025-06-04T15:45:21.823ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2242025-06-04T15:45:21.823ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2252025-06-04T15:45:21.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2262025-06-04T15:45:21.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2272025-06-04T15:45:21.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2282025-06-04T15:45:21.838ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
2292025-06-04T15:45:21.838ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 91.437594ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
2302025-06-04T15:45:21.845ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
2312025-06-04T15:45:21.845ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2322025-06-04T15:45:21.845ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "91bbc25c-4da8-4dd2-b29e-acff1c1dbdea", "content-length": "26", "date": "Wed, 04 Jun 2025 15:45:21 GMT"} })
2332025-06-04T15:45:21.845ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2342025-06-04T15:45:21.848ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2352025-06-04T15:45:21.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.646172ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2362025-06-04T15:45:21.852ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
2372025-06-04T15:45:21.852ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2382025-06-04T15:45:21.852ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2392025-06-04T15:45:21.852ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2402025-06-04T15:45:21.852ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 104.559836ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2412025-06-04T15:45:21.852ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6260dccb-087c-413a-b8be-51267851adc5", "content-length": "26", "date": "Wed, 04 Jun 2025 15:45:21 GMT"} })
2422025-06-04T15:45:21.852ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2432025-06-04T15:45:21.854ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2442025-06-04T15:45:21.856ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2452025-06-04T15:45:21.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 100.420815ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
2462025-06-04T15:45:21.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
2472025-06-04T15:45:21.858ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2482025-06-04T15:45:21.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2492025-06-04T15:45:21.861ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 113.474126ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2502025-06-04T15:45:21.895ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
2512025-06-04T15:45:21.895ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 147.99399ms iteration = 20 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
2522025-06-04T15:45:21.896ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2532025-06-04T15:45:21.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2542025-06-04T15:45:21.900ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 zone_address = fd00:1122:3344:101::2
2552025-06-04T15:45:21.900ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2562025-06-04T15:45:21.900ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "35ebb533-df92-46eb-a8ec-3d6d0fa8eb6f", "content-length": "26", "date": "Wed, 04 Jun 2025 15:45:21 GMT"} })
2572025-06-04T15:45:21.900ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2582025-06-04T15:45:21.902ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
2592025-06-04T15:45:21.937ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
2602025-06-04T15:45:21.937ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2612025-06-04T15:45:21.937ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c7beb96-44cc-4b0c-9cc2-a7dff034c01a", "content-length": "372", "date": "Wed, 04 Jun 2025 15:45:21 GMT"} })
2622025-06-04T15:45:21.937ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2632025-06-04T15:45:21.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2642025-06-04T15:45:21.938ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 191.659986ms iteration = 22 status = {"physical_disks_added":0}
2652025-06-04T15:45:21.938ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2662025-06-04T15:45:21.940ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2672025-06-04T15:45:21.940ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2682025-06-04T15:45:21.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2692025-06-04T15:45:21.942ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2702025-06-04T15:45:21.944ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2712025-06-04T15:45:21.944ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2722025-06-04T15:45:21.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2732025-06-04T15:45:21.953ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
2742025-06-04T15:45:21.953ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
2752025-06-04T15:45:21.953ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c98792ea-4dd2-495e-bcb5-2fbdf2b3d51b", "date": "Wed, 04 Jun 2025 15:45:21 GMT"} })
2762025-06-04T15:45:21.953ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2772025-06-04T15:45:21.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2782025-06-04T15:45:21.956ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2792025-06-04T15:45:21.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2802025-06-04T15:45:21.960ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2812025-06-04T15:45:21.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2822025-06-04T15:45:21.963ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
2832025-06-04T15:45:21.963ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2842025-06-04T15:45:21.964ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bb5244a0-fa31-456f-9c26-3705086c29aa", "date": "Wed, 04 Jun 2025 15:45:21 GMT"} })
2852025-06-04T15:45:21.965ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 218.244553ms iteration = 20 status = {}
2862025-06-04T15:45:21.966ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 220.915996ms iteration = 20 status = {}
2872025-06-04T15:45:22.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bf4389dd-e43f-43f0-bf48-5ef24e183bf3 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
2882025-06-04T15:45:22.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bf4389dd-e43f-43f0-bf48-5ef24e183bf3 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
2892025-06-04T15:45:22.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bf4389dd-e43f-43f0-bf48-5ef24e183bf3 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
2902025-06-04T15:45:22.054ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
2912025-06-04T15:45:22.055ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3d40008-b8ba-4a4a-961c-067d77d2c6de", "content-length": "691", "date": "Wed, 04 Jun 2025 15:45:21 GMT"} })
2922025-06-04T15:45:22.055ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
2932025-06-04T15:45:22.055ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
2942025-06-04T15:45:22.055ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
2952025-06-04T15:45:22.057ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 309.276013ms iteration = 20 status = {}
2962025-06-04T15:45:22.061ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2972025-06-04T15:45:22.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2982025-06-04T15:45:22.063ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 318.463586ms iteration = 20 status = null
2992025-06-04T15:45:22.125ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3002025-06-04T15:45:22.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3012025-06-04T15:45:22.127ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 8dbb977a-0cb9-4cf4-916b-4e19edd41b70, rack_id: 2302d566-cff7-41c0-b6e9-4f6ac6057661, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(aeecc71f-0b8d-4aaf-8e0e-04ee00063f7a) } rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0
3022025-06-04T15:45:22.127ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3032025-06-04T15:45:22.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3042025-06-04T15:45:22.140ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
3052025-06-04T15:45:22.140ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = aeecc71f-0b8d-4aaf-8e0e-04ee00063f7a
3062025-06-04T15:45:22.140ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
3072025-06-04T15:45:22.140ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
3082025-06-04T15:45:22.140ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3092025-06-04T15:45:22.140ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3102025-06-04T15:45:22.140ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3112025-06-04T15:45:22.140ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3122025-06-04T15:45:22.140ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3132025-06-04T15:45:22.140ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3142025-06-04T15:45:22.141ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
3152025-06-04T15:45:22.141ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3162025-06-04T15:45:22.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3172025-06-04T15:45:22.144ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0
3182025-06-04T15:45:22.144ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
3192025-06-04T15:45:22.256ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "df9aec9c-6881-4f3d-89ca-119d183fd00b", "date": "Wed, 04 Jun 2025 15:45:21 GMT"} })
3202025-06-04T15:45:22.256ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch = Switch0
3212025-06-04T15:45:22.256ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
3222025-06-04T15:45:22.256ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "62b4b13a-36f9-4427-8409-4d5c2293e15a", "content-length": "682", "date": "Wed, 04 Jun 2025 15:45:21 GMT"} })
3232025-06-04T15:45:22.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3242025-06-04T15:45:22.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3252025-06-04T15:45:22.260ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3262025-06-04T15:45:22.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3272025-06-04T15:45:22.263ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3282025-06-04T15:45:22.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3292025-06-04T15:45:22.265ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3302025-06-04T15:45:22.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3312025-06-04T15:45:22.272ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 525.681043ms iteration = 20 status = {}
3322025-06-04T15:45:23.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bd21526d-e1a2-4ee6-821f-15f2ac351b70 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3332025-06-04T15:45:23.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bd21526d-e1a2-4ee6-821f-15f2ac351b70 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3342025-06-04T15:45:23.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1600 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bd21526d-e1a2-4ee6-821f-15f2ac351b70 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3352025-06-04T15:45:24.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 87ae1ee7-3f62-4d6a-bafa-11d586e174ca roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3362025-06-04T15:45:24.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 87ae1ee7-3f62-4d6a-bafa-11d586e174ca resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3372025-06-04T15:45:24.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 87ae1ee7-3f62-4d6a-bafa-11d586e174ca response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3382025-06-04T15:45:25.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7bc7ed37-6541-4e1d-9107-c05b73e77026 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3392025-06-04T15:45:25.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7bc7ed37-6541-4e1d-9107-c05b73e77026 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3402025-06-04T15:45:25.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7bc7ed37-6541-4e1d-9107-c05b73e77026 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3412025-06-04T15:45:26.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9cac4672-e459-4cfc-8f39-b23b5283b045 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3422025-06-04T15:45:26.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9cac4672-e459-4cfc-8f39-b23b5283b045 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3432025-06-04T15:45:26.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2635 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9cac4672-e459-4cfc-8f39-b23b5283b045 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3442025-06-04T15:45:27.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8152bdc5-9937-44ef-a20a-46035d10adf6 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3452025-06-04T15:45:27.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8152bdc5-9937-44ef-a20a-46035d10adf6 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3462025-06-04T15:45:27.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8152bdc5-9937-44ef-a20a-46035d10adf6 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3472025-06-04T15:45:28.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = c52df598-7430-4c71-af22-bc40702ed0ee roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3482025-06-04T15:45:28.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = c52df598-7430-4c71-af22-bc40702ed0ee resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3492025-06-04T15:45:28.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1782 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = c52df598-7430-4c71-af22-bc40702ed0ee response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3502025-06-04T15:45:29.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8d7987a4-1a95-42d1-8547-de0870e83f2e roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3512025-06-04T15:45:29.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8d7987a4-1a95-42d1-8547-de0870e83f2e resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3522025-06-04T15:45:29.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8d7987a4-1a95-42d1-8547-de0870e83f2e response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3532025-06-04T15:45:29.949ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 471 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = e98e1b95-a9a6-447b-b3d8-c9f894c4bef2 response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
3542025-06-04T15:45:30.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 62ce5f76-d66d-42ac-a2c3-e82322837cb9 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3552025-06-04T15:45:30.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 62ce5f76-d66d-42ac-a2c3-e82322837cb9 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3562025-06-04T15:45:30.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2480 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 62ce5f76-d66d-42ac-a2c3-e82322837cb9 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3572025-06-04T15:45:31.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3a961918-e802-460e-918a-5c66426f754a roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3582025-06-04T15:45:31.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3a961918-e802-460e-918a-5c66426f754a resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3592025-06-04T15:45:31.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1906 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3a961918-e802-460e-918a-5c66426f754a response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3602025-06-04T15:45:31.747ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
3612025-06-04T15:45:31.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3622025-06-04T15:45:31.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3632025-06-04T15:45:31.748ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
3642025-06-04T15:45:31.748ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3652025-06-04T15:45:31.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3662025-06-04T15:45:31.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3672025-06-04T15:45:31.749ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3682025-06-04T15:45:31.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3692025-06-04T15:45:31.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3702025-06-04T15:45:31.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3712025-06-04T15:45:31.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3722025-06-04T15:45:31.755ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3732025-06-04T15:45:31.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3742025-06-04T15:45:31.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3752025-06-04T15:45:31.759ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
3762025-06-04T15:45:31.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3772025-06-04T15:45:31.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3782025-06-04T15:45:31.770ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
3792025-06-04T15:45:31.770ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.565837ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
3802025-06-04T15:45:31.783ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.611328ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3812025-06-04T15:45:32.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 00864626-4dd2-439f-b4b3-44acac0ff55d roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3822025-06-04T15:45:32.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 00864626-4dd2-439f-b4b3-44acac0ff55d resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3832025-06-04T15:45:32.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 00864626-4dd2-439f-b4b3-44acac0ff55d response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3842025-06-04T15:45:33.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6a1becc4-c9b5-4dea-b5d5-31caceab084b roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3852025-06-04T15:45:33.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6a1becc4-c9b5-4dea-b5d5-31caceab084b resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3862025-06-04T15:45:33.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6a1becc4-c9b5-4dea-b5d5-31caceab084b response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3872025-06-04T15:45:34.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5e214241-4125-421a-8627-6f7fabcc0dec roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3882025-06-04T15:45:34.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5e214241-4125-421a-8627-6f7fabcc0dec resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3892025-06-04T15:45:34.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5e214241-4125-421a-8627-6f7fabcc0dec response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3902025-06-04T15:45:35.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9b2889a3-edbe-47f2-ac6e-75135f83f2fa roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3912025-06-04T15:45:35.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9b2889a3-edbe-47f2-ac6e-75135f83f2fa resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3922025-06-04T15:45:35.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9b2889a3-edbe-47f2-ac6e-75135f83f2fa response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3932025-06-04T15:45:36.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3283c2a9-9dfa-477f-b620-f3523b31296a roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3942025-06-04T15:45:36.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3283c2a9-9dfa-477f-b620-f3523b31296a resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3952025-06-04T15:45:36.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3283c2a9-9dfa-477f-b620-f3523b31296a response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3962025-06-04T15:45:37.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = afff86f5-f664-43dd-84e5-3ad3c6d42392 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3972025-06-04T15:45:37.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = afff86f5-f664-43dd-84e5-3ad3c6d42392 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3982025-06-04T15:45:37.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = afff86f5-f664-43dd-84e5-3ad3c6d42392 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
3992025-06-04T15:45:38.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b0fd43c2-1e42-4a9b-94b2-84c3aa56f3c0 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4002025-06-04T15:45:38.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b0fd43c2-1e42-4a9b-94b2-84c3aa56f3c0 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4012025-06-04T15:45:38.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b0fd43c2-1e42-4a9b-94b2-84c3aa56f3c0 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4022025-06-04T15:45:39.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9fc649a1-29b4-474d-821e-391b5ace4e09 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4032025-06-04T15:45:39.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9fc649a1-29b4-474d-821e-391b5ace4e09 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4042025-06-04T15:45:39.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9fc649a1-29b4-474d-821e-391b5ace4e09 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4052025-06-04T15:45:39.948ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 469 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = cc3f5cab-024d-484b-b410-71c9583f6dfb response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
4062025-06-04T15:45:40.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 608dec06-6b6b-41e1-9be8-528a06aaeb86 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4072025-06-04T15:45:40.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 608dec06-6b6b-41e1-9be8-528a06aaeb86 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4082025-06-04T15:45:40.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2500 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 608dec06-6b6b-41e1-9be8-528a06aaeb86 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4092025-06-04T15:45:41.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a887088f-5d2b-4817-97d0-b8bf56d55c7c roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4102025-06-04T15:45:41.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a887088f-5d2b-4817-97d0-b8bf56d55c7c resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4112025-06-04T15:45:41.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a887088f-5d2b-4817-97d0-b8bf56d55c7c response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4122025-06-04T15:45:41.747ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
4132025-06-04T15:45:41.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4142025-06-04T15:45:41.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4152025-06-04T15:45:41.748ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
4162025-06-04T15:45:41.748ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4172025-06-04T15:45:41.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4182025-06-04T15:45:41.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4192025-06-04T15:45:41.750ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4202025-06-04T15:45:41.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4212025-06-04T15:45:41.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4222025-06-04T15:45:41.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4232025-06-04T15:45:41.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4242025-06-04T15:45:41.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4252025-06-04T15:45:41.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4262025-06-04T15:45:41.755ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4272025-06-04T15:45:41.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
4282025-06-04T15:45:41.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4292025-06-04T15:45:41.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4302025-06-04T15:45:41.766ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
4312025-06-04T15:45:41.766ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.300605ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
4322025-06-04T15:45:41.784ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.633411ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4332025-06-04T15:45:42.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 1d7296f7-04b2-42ff-b7a8-84318ecaf50e roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4342025-06-04T15:45:42.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 1d7296f7-04b2-42ff-b7a8-84318ecaf50e resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4352025-06-04T15:45:42.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 1d7296f7-04b2-42ff-b7a8-84318ecaf50e response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4362025-06-04T15:45:43.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a76b9c8e-bdf6-48be-9fab-7f63f60cb400 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4372025-06-04T15:45:43.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a76b9c8e-bdf6-48be-9fab-7f63f60cb400 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4382025-06-04T15:45:43.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a76b9c8e-bdf6-48be-9fab-7f63f60cb400 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4392025-06-04T15:45:44.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ad6489d0-ff80-4477-8c13-7f4301605440 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4402025-06-04T15:45:44.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ad6489d0-ff80-4477-8c13-7f4301605440 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4412025-06-04T15:45:44.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1850 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ad6489d0-ff80-4477-8c13-7f4301605440 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4422025-06-04T15:45:45.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9c8edf8a-ffb0-4a41-a680-af1b9e020896 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4432025-06-04T15:45:45.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9c8edf8a-ffb0-4a41-a680-af1b9e020896 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4442025-06-04T15:45:45.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9c8edf8a-ffb0-4a41-a680-af1b9e020896 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4452025-06-04T15:45:46.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a1d5b4be-ae9e-47c4-8d10-9e667934531b roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4462025-06-04T15:45:46.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a1d5b4be-ae9e-47c4-8d10-9e667934531b resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4472025-06-04T15:45:46.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1690 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a1d5b4be-ae9e-47c4-8d10-9e667934531b response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4482025-06-04T15:45:47.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bb931209-621f-45db-8b73-564bd26dc44e roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4492025-06-04T15:45:47.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bb931209-621f-45db-8b73-564bd26dc44e resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4502025-06-04T15:45:47.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bb931209-621f-45db-8b73-564bd26dc44e response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4512025-06-04T15:45:48.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 40923732-dc29-4a34-85b1-4c2c8724efae roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4522025-06-04T15:45:48.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 40923732-dc29-4a34-85b1-4c2c8724efae resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4532025-06-04T15:45:48.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 40923732-dc29-4a34-85b1-4c2c8724efae response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4542025-06-04T15:45:49.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a2d5e07c-bc47-4fe0-9ab7-72cf21be2057 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4552025-06-04T15:45:49.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a2d5e07c-bc47-4fe0-9ab7-72cf21be2057 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4562025-06-04T15:45:49.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a2d5e07c-bc47-4fe0-9ab7-72cf21be2057 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4572025-06-04T15:45:49.948ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 494 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = 551ca119-d0ec-430c-82f2-aa8bfb125cc3 response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
4582025-06-04T15:45:50.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e45714c7-03d8-4147-8adb-677cf3e87fe6 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4592025-06-04T15:45:50.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e45714c7-03d8-4147-8adb-677cf3e87fe6 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4602025-06-04T15:45:50.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e45714c7-03d8-4147-8adb-677cf3e87fe6 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4612025-06-04T15:45:51.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e89cd4f8-ac47-4f25-8e02-05292c5e244d roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4622025-06-04T15:45:51.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e89cd4f8-ac47-4f25-8e02-05292c5e244d resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4632025-06-04T15:45:51.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e89cd4f8-ac47-4f25-8e02-05292c5e244d response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
4642025-06-04T15:45:51.745ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
4652025-06-04T15:45:51.745ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4662025-06-04T15:45:51.745ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
4672025-06-04T15:45:51.745ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
4682025-06-04T15:45:51.745ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
4692025-06-04T15:45:51.745ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4702025-06-04T15:45:51.745ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
4712025-06-04T15:45:51.745ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
4722025-06-04T15:45:51.745ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4732025-06-04T15:45:51.745ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4742025-06-04T15:45:51.745ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4752025-06-04T15:45:51.745ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
4762025-06-04T15:45:51.745ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
4772025-06-04T15:45:51.745ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-04 15:35:51.745384888 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4782025-06-04T15:45:51.745ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
4792025-06-04T15:45:51.745ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4802025-06-04T15:45:51.745ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4812025-06-04T15:45:51.745ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
4822025-06-04T15:45:51.745ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4832025-06-04T15:45:51.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4842025-06-04T15:45:51.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4852025-06-04T15:45:51.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4862025-06-04T15:45:51.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4872025-06-04T15:45:51.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4882025-06-04T15:45:51.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4892025-06-04T15:45:51.746ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("74458287-879a-4471-829f-da352f40aff2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("84104d89-910f-45b9-adb6-d23a6d4f41d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("84104d89-910f-45b9-adb6-d23a6d4f41d6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1919, tv_nsec: 888073082 } })
4902025-06-04T15:45:51.746ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d97642c-17fd-4803-bc28-7ad83219ce8c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("91bdae66-8e10-4892-9bfd-517dee32a9bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e10264ea-c7fb-4742-9452-fa5e125ebf3d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e10264ea-c7fb-4742-9452-fa5e125ebf3d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1919, tv_nsec: 888074192 } })
4912025-06-04T15:45:51.746ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
4922025-06-04T15:45:51.746ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.164384ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
4932025-06-04T15:45:51.746ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
4942025-06-04T15:45:51.746ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.380617ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
4952025-06-04T15:45:51.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4962025-06-04T15:45:51.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4972025-06-04T15:45:51.747ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
4982025-06-04T15:45:51.747ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
4992025-06-04T15:45:51.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5002025-06-04T15:45:51.747ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
5012025-06-04T15:45:51.747ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
5022025-06-04T15:45:51.747ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
5032025-06-04T15:45:51.747ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5042025-06-04T15:45:51.747ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf
5052025-06-04T15:45:51.747ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.901\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf"}
5062025-06-04T15:45:51.747ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 5 reason = Timeout
5072025-06-04T15:45:51.747ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
5082025-06-04T15:45:51.747ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 21 reason = Timeout
5092025-06-04T15:45:51.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
5102025-06-04T15:45:51.747ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
5112025-06-04T15:45:51.747ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5122025-06-04T15:45:51.747ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
5132025-06-04T15:45:51.747ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5142025-06-04T15:45:51.747ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
5152025-06-04T15:45:51.747ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5162025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5172025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5182025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5192025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
5202025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
5212025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5222025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5232025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
5242025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
5252025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
5262025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
5272025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
5282025-06-04T15:45:51.748ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
5292025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5302025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
5312025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
5322025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5332025-06-04T15:45:51.748ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
5342025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5352025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5362025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
5372025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5382025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
5392025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5402025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
5412025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5422025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5432025-06-04T15:45:51.748ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1919, tv_nsec: 890786625 } })
5442025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5452025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5462025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5472025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5482025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5492025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5502025-06-04T15:45:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5512025-06-04T15:45:51.749ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
5522025-06-04T15:45:51.749ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5532025-06-04T15:45:51.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5542025-06-04T15:45:51.749ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5552025-06-04T15:45:51.749ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-04 15:35:51.745384888 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5562025-06-04T15:45:51.750ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.593646ms iteration = 11 status = {"expiration":"2025-06-04T15:35:51.745384888Z","pruned":[]}
5572025-06-04T15:45:51.750ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1919, tv_nsec: 892520546 } })
5582025-06-04T15:45:51.750ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
5592025-06-04T15:45:51.751ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5602025-06-04T15:45:51.753ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5612025-06-04T15:45:51.753ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5622025-06-04T15:45:51.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5632025-06-04T15:45:51.753ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.926553ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5642025-06-04T15:45:51.755ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5652025-06-04T15:45:51.755ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5662025-06-04T15:45:51.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5672025-06-04T15:45:51.756ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
5682025-06-04T15:45:51.756ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
5692025-06-04T15:45:51.756ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
5702025-06-04T15:45:51.756ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
5712025-06-04T15:45:51.756ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5722025-06-04T15:45:51.756ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
5732025-06-04T15:45:51.756ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 3 reason = Timeout
5742025-06-04T15:45:51.756ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
5752025-06-04T15:45:51.756ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
5762025-06-04T15:45:51.756ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5772025-06-04T15:45:51.756ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
5782025-06-04T15:45:51.756ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
5792025-06-04T15:45:51.756ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
5802025-06-04T15:45:51.756ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
5812025-06-04T15:45:51.756ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
5822025-06-04T15:45:51.756ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
5832025-06-04T15:45:51.756ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
5842025-06-04T15:45:51.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5852025-06-04T15:45:51.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5862025-06-04T15:45:51.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5872025-06-04T15:45:51.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
5882025-06-04T15:45:51.757ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
5892025-06-04T15:45:51.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5902025-06-04T15:45:51.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5912025-06-04T15:45:51.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5922025-06-04T15:45:51.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5932025-06-04T15:45:51.758ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5942025-06-04T15:45:51.760ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 21 reason = Timeout
5952025-06-04T15:45:51.760ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
5962025-06-04T15:45:51.760ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 11 reason = Timeout
5972025-06-04T15:45:51.760ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
5982025-06-04T15:45:51.760ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 11 reason = Timeout
5992025-06-04T15:45:51.760ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
6002025-06-04T15:45:51.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
6012025-06-04T15:45:51.760ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
6022025-06-04T15:45:51.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
6032025-06-04T15:45:51.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
6042025-06-04T15:45:51.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
6052025-06-04T15:45:51.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
6062025-06-04T15:45:51.761ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6072025-06-04T15:45:51.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6082025-06-04T15:45:51.761ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
6092025-06-04T15:45:51.761ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6102025-06-04T15:45:51.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
6112025-06-04T15:45:51.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6122025-06-04T15:45:51.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
6132025-06-04T15:45:51.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
6142025-06-04T15:45:51.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
6152025-06-04T15:45:51.764ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6162025-06-04T15:45:51.764ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6172025-06-04T15:45:51.765ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6182025-06-04T15:45:51.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6192025-06-04T15:45:51.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6202025-06-04T15:45:51.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6212025-06-04T15:45:51.768ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6222025-06-04T15:45:51.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6232025-06-04T15:45:51.769ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6242025-06-04T15:45:51.769ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6252025-06-04T15:45:51.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6262025-06-04T15:45:51.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
6272025-06-04T15:45:51.769ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6282025-06-04T15:45:51.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6292025-06-04T15:45:51.770ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6302025-06-04T15:45:51.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6312025-06-04T15:45:51.773ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6322025-06-04T15:45:51.774ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6332025-06-04T15:45:51.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
6342025-06-04T15:45:51.776ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6352025-06-04T15:45:51.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6362025-06-04T15:45:51.777ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6372025-06-04T15:45:51.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6382025-06-04T15:45:51.779ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6392025-06-04T15:45:51.779ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.724809ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
6402025-06-04T15:45:51.781ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6412025-06-04T15:45:51.784ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
6422025-06-04T15:45:51.784ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
6432025-06-04T15:45:51.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
6442025-06-04T15:45:51.788ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
6452025-06-04T15:45:51.788ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 27.780422ms iteration = 11 status = {"by_rx":{},"error":null}
6462025-06-04T15:45:51.789ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
6472025-06-04T15:45:51.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
6482025-06-04T15:45:51.790ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6492025-06-04T15:45:51.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6502025-06-04T15:45:51.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6512025-06-04T15:45:51.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6522025-06-04T15:45:51.803ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6532025-06-04T15:45:51.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6542025-06-04T15:45:51.805ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6552025-06-04T15:45:51.809ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6562025-06-04T15:45:51.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6572025-06-04T15:45:51.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6582025-06-04T15:45:51.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6592025-06-04T15:45:51.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6602025-06-04T15:45:51.815ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
6612025-06-04T15:45:51.815ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
6622025-06-04T15:45:51.815ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
6632025-06-04T15:45:51.815ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6642025-06-04T15:45:51.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6652025-06-04T15:45:51.817ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.321662ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6662025-06-04T15:45:51.822ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6672025-06-04T15:45:51.822ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6682025-06-04T15:45:51.822ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
6692025-06-04T15:45:51.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6702025-06-04T15:45:51.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6712025-06-04T15:45:51.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
6722025-06-04T15:45:51.826ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6732025-06-04T15:45:51.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6742025-06-04T15:45:51.828ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6752025-06-04T15:45:51.832ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
6762025-06-04T15:45:51.832ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 75.302016ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
6772025-06-04T15:45:51.832ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1919, tv_nsec: 974333482 } })
6782025-06-04T15:45:51.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6792025-06-04T15:45:51.832ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6802025-06-04T15:45:51.832ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
6812025-06-04T15:45:51.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6822025-06-04T15:45:51.834ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6832025-06-04T15:45:51.834ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 74.301944ms iteration = 21 status = {"errors":[],"requests_created_ok":[]}
6842025-06-04T15:45:51.835ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
6852025-06-04T15:45:51.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
6862025-06-04T15:45:51.836ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6872025-06-04T15:45:51.836ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6882025-06-04T15:45:51.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6892025-06-04T15:45:51.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6902025-06-04T15:45:51.837ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
6912025-06-04T15:45:51.837ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
6922025-06-04T15:45:51.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
6932025-06-04T15:45:51.839ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6942025-06-04T15:45:51.839ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6952025-06-04T15:45:51.839ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 83.147482ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6962025-06-04T15:45:51.844ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
6972025-06-04T15:45:51.844ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
6982025-06-04T15:45:51.844ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
6992025-06-04T15:45:51.844ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7002025-06-04T15:45:51.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7012025-06-04T15:45:51.846ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7022025-06-04T15:45:51.847ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7032025-06-04T15:45:51.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7042025-06-04T15:45:51.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7052025-06-04T15:45:51.849ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7062025-06-04T15:45:51.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7072025-06-04T15:45:51.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 93.420839ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
7082025-06-04T15:45:51.850ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 90.210179ms iteration = 11 status = {"dispatched":[],"errors":[],"glob_version":"147.0.0","globs_reprocessed":{},"no_receivers":[]}
7092025-06-04T15:45:51.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 96.219132ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7102025-06-04T15:45:51.853ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7112025-06-04T15:45:51.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7122025-06-04T15:45:51.853ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7132025-06-04T15:45:51.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7142025-06-04T15:45:51.855ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 98.946526ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
7152025-06-04T15:45:51.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7162025-06-04T15:45:51.858ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7172025-06-04T15:45:51.859ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
7182025-06-04T15:45:51.859ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
7192025-06-04T15:45:51.859ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 112.179879ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
7202025-06-04T15:45:51.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
7212025-06-04T15:45:51.862ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7222025-06-04T15:45:51.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7232025-06-04T15:45:51.862ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7242025-06-04T15:45:51.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7252025-06-04T15:45:51.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7262025-06-04T15:45:51.863ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7272025-06-04T15:45:51.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7282025-06-04T15:45:51.864ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7292025-06-04T15:45:51.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7302025-06-04T15:45:51.866ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7312025-06-04T15:45:51.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7322025-06-04T15:45:51.871ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7332025-06-04T15:45:51.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7342025-06-04T15:45:51.876ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7352025-06-04T15:45:51.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7362025-06-04T15:45:51.878ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7372025-06-04T15:45:51.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7382025-06-04T15:45:51.881ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7392025-06-04T15:45:51.882ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
7402025-06-04T15:45:51.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
7412025-06-04T15:45:51.884ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7422025-06-04T15:45:51.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7432025-06-04T15:45:51.885ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7442025-06-04T15:45:51.885ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7452025-06-04T15:45:51.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7462025-06-04T15:45:51.891ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7472025-06-04T15:45:51.891ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
7482025-06-04T15:45:51.891ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 143.226631ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
7492025-06-04T15:45:51.891ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7502025-06-04T15:45:51.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7512025-06-04T15:45:51.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7522025-06-04T15:45:51.894ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7532025-06-04T15:45:51.895ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7542025-06-04T15:45:51.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7552025-06-04T15:45:51.897ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7562025-06-04T15:45:51.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7572025-06-04T15:45:51.898ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e751cd2d-7b1b-4ea0-8b5a-62525772a5f5, lookup_type: ById(e751cd2d-7b1b-4ea0-8b5a-62525772a5f5) } result = Ok(())
7582025-06-04T15:45:51.898ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7592025-06-04T15:45:51.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7602025-06-04T15:45:51.900ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 152.989171ms iteration = 21 status = 0
7612025-06-04T15:45:51.901ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7622025-06-04T15:45:51.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7632025-06-04T15:45:51.903ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7642025-06-04T15:45:51.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7652025-06-04T15:45:51.905ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
7662025-06-04T15:45:51.905ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 157.546997ms iteration = 21 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
7672025-06-04T15:45:51.905ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7682025-06-04T15:45:51.905ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7692025-06-04T15:45:51.905ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7702025-06-04T15:45:51.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7712025-06-04T15:45:51.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7722025-06-04T15:45:51.907ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7732025-06-04T15:45:51.908ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7742025-06-04T15:45:51.908ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
7752025-06-04T15:45:51.908ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7762025-06-04T15:45:51.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7772025-06-04T15:45:51.909ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7782025-06-04T15:45:51.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
7792025-06-04T15:45:51.910ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7802025-06-04T15:45:51.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7812025-06-04T15:45:51.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
7822025-06-04T15:45:51.910ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7832025-06-04T15:45:51.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7842025-06-04T15:45:51.911ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7852025-06-04T15:45:51.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7862025-06-04T15:45:51.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
7872025-06-04T15:45:51.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7882025-06-04T15:45:51.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7892025-06-04T15:45:51.913ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7902025-06-04T15:45:51.913ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7912025-06-04T15:45:51.913ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 165.175161ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7922025-06-04T15:45:51.915ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 167.211336ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7932025-06-04T15:45:51.916ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
7942025-06-04T15:45:51.916ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 4b1484ba-d395-4f36-93b6-c834b9680ee9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
7952025-06-04T15:45:51.916ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7962025-06-04T15:45:51.916ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
7972025-06-04T15:45:51.916ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3a2843d7-1e1c-47e4-9521-1eb938c0106b dns_zone_name = oxide.test found_so_far = 0 version = 2
7982025-06-04T15:45:51.916ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7992025-06-04T15:45:51.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8002025-06-04T15:45:51.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8012025-06-04T15:45:51.918ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8022025-06-04T15:45:51.918ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8032025-06-04T15:45:51.921ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
8042025-06-04T15:45:51.921ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8052025-06-04T15:45:51.921ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "242b03c5-476e-4d11-95ea-7fec8f51df8c", "content-length": "26", "date": "Wed, 04 Jun 2025 15:45:51 GMT"} })
8062025-06-04T15:45:51.921ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8072025-06-04T15:45:51.923ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
8082025-06-04T15:45:51.923ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8092025-06-04T15:45:51.923ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8102025-06-04T15:45:51.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8112025-06-04T15:45:51.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
8122025-06-04T15:45:51.924ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8132025-06-04T15:45:51.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8142025-06-04T15:45:51.932ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 4b1484ba-d395-4f36-93b6-c834b9680ee9 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
8152025-06-04T15:45:51.932ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
8162025-06-04T15:45:51.932ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-04 15:35:53.349408 UTC dns_group = internal generation = 1
8172025-06-04T15:45:51.932ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 186.660485ms iteration = 11 status = {"generation":1}
8182025-06-04T15:45:51.932ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8192025-06-04T15:45:51.932ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3a2843d7-1e1c-47e4-9521-1eb938c0106b dns_zone_name = oxide.test found_so_far = 4 version = 2
8202025-06-04T15:45:51.932ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
8212025-06-04T15:45:51.932ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-04 15:35:55.637968 UTC dns_group = external generation = 2
8222025-06-04T15:45:51.932ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 187.270023ms iteration = 11 status = {"generation":2}
8232025-06-04T15:45:51.935ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
8242025-06-04T15:45:51.935ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
8252025-06-04T15:45:51.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
8262025-06-04T15:45:51.945ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8272025-06-04T15:45:51.948ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
8282025-06-04T15:45:51.948ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
8292025-06-04T15:45:51.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
8302025-06-04T15:45:51.949ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
8312025-06-04T15:45:51.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
8322025-06-04T15:45:51.950ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
8332025-06-04T15:45:51.950ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 202.819764ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
8342025-06-04T15:45:51.950ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
8352025-06-04T15:45:51.950ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8362025-06-04T15:45:51.951ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e34b3edd-81d0-4b2c-94ad-4902733103b4", "content-length": "26", "date": "Wed, 04 Jun 2025 15:45:51 GMT"} })
8372025-06-04T15:45:51.951ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8382025-06-04T15:45:51.951ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8392025-06-04T15:45:51.952ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8402025-06-04T15:45:51.953ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8412025-06-04T15:45:51.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8422025-06-04T15:45:51.954ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
8432025-06-04T15:45:51.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
8442025-06-04T15:45:51.956ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
8452025-06-04T15:45:51.956ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
8462025-06-04T15:45:51.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
8472025-06-04T15:45:51.959ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8482025-06-04T15:45:51.961ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8492025-06-04T15:45:51.962ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
8502025-06-04T15:45:51.962ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
8512025-06-04T15:45:51.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
8522025-06-04T15:45:51.966ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
8532025-06-04T15:45:51.966ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8542025-06-04T15:45:51.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8552025-06-04T15:45:51.975ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 218.628988ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
8562025-06-04T15:45:51.991ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-04T15:35:43.043689Z, time_modified: 2025-06-04T15:35:43.043689Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: bcca9629-d8e0-4351-a4fb-8029b18eb633, db_silo: Silo { identity: SiloIdentity { id: bcca9629-d8e0-4351-a4fb-8029b18eb633, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-04T15:35:55.573183Z, time_modified: 2025-06-04T15:35:55.573183Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a49af7a2313337b84535ddab02a38b7781b3f7789d0df44311ad2658fa92170d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: bcca9629-d8e0-4351-a4fb-8029b18eb633, db_silo: Silo { identity: SiloIdentity { id: bcca9629-d8e0-4351-a4fb-8029b18eb633, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-04T15:35:55.573183Z, time_modified: 2025-06-04T15:35:55.573183Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a49af7a2313337b84535ddab02a38b7781b3f7789d0df44311ad2658fa92170d" }] }) }
8572025-06-04T15:45:51.991ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 246.010895ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"bcca9629-d8e0-4351-a4fb-8029b18eb633","tls_certs":["a49af7a2313337b84535ddab02a38b7781b3f7789d0df44311ad2658fa92170d"]}},"default_endpoint":{"silo_id":"bcca9629-d8e0-4351-a4fb-8029b18eb633","tls_certs":["a49af7a2313337b84535ddab02a38b7781b3f7789d0df44311ad2658fa92170d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
8582025-06-04T15:45:52.011ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
8592025-06-04T15:45:52.018ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8602025-06-04T15:45:52.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8612025-06-04T15:45:52.021ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 273.366922ms iteration = 23 status = {"physical_disks_added":0}
8622025-06-04T15:45:52.083ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
8632025-06-04T15:45:52.083ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 334.776766ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
8642025-06-04T15:45:52.102ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 zone_address = fd00:1122:3344:101::2
8652025-06-04T15:45:52.102ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8662025-06-04T15:45:52.102ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5fcd272-8663-4d1b-a11e-9105f4f4e0d5", "content-length": "26", "date": "Wed, 04 Jun 2025 15:45:51 GMT"} })
8672025-06-04T15:45:52.102ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8682025-06-04T15:45:52.104ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
8692025-06-04T15:45:52.123ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
8702025-06-04T15:45:52.192ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
8712025-06-04T15:45:52.192ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8722025-06-04T15:45:52.192ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e4441fa-950b-4268-b38a-c70f2dfc7c02", "content-length": "372", "date": "Wed, 04 Jun 2025 15:45:52 GMT"} })
8732025-06-04T15:45:52.192ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8742025-06-04T15:45:52.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8752025-06-04T15:45:52.194ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8762025-06-04T15:45:52.194ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8772025-06-04T15:45:52.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8782025-06-04T15:45:52.195ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
8792025-06-04T15:45:52.195ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 447.619583ms iteration = 5 status = {"blueprint_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","inventory_collection_id":"0fa536fb-5bd1-429d-8d58-e5d8db638da6","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
8802025-06-04T15:45:52.197ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8812025-06-04T15:45:52.197ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8822025-06-04T15:45:52.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8832025-06-04T15:45:52.306ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
8842025-06-04T15:45:52.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
8852025-06-04T15:45:52.310ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8862025-06-04T15:45:52.310ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8872025-06-04T15:45:52.310ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 565.410762ms iteration = 21 status = {}
8882025-06-04T15:45:52.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8892025-06-04T15:45:52.312ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8902025-06-04T15:45:52.312ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8912025-06-04T15:45:52.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8922025-06-04T15:45:52.319ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8932025-06-04T15:45:52.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8942025-06-04T15:45:52.322ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8952025-06-04T15:45:52.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8962025-06-04T15:45:52.324ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8972025-06-04T15:45:52.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8982025-06-04T15:45:52.325ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8992025-06-04T15:45:52.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9002025-06-04T15:45:52.327ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9012025-06-04T15:45:52.333ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
9022025-06-04T15:45:52.333ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9032025-06-04T15:45:52.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9042025-06-04T15:45:52.353ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9052025-06-04T15:45:52.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
9062025-06-04T15:45:52.355ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
9072025-06-04T15:45:52.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
9082025-06-04T15:45:52.356ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9092025-06-04T15:45:52.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9102025-06-04T15:45:52.357ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
9112025-06-04T15:45:52.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
9122025-06-04T15:45:52.358ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 613.325971ms iteration = 21 status = null
9132025-06-04T15:45:52.359ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9142025-06-04T15:45:52.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
9152025-06-04T15:45:52.361ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
9162025-06-04T15:45:52.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
9172025-06-04T15:45:52.364ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/artifacts-config
9182025-06-04T15:45:52.364ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts-config", status: 204, headers: {"x-request-id": "f0f690e5-25e2-4dda-a0cc-4481b0184867", "date": "Wed, 04 Jun 2025 15:45:52 GMT"} })
9192025-06-04T15:45:52.364ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
9202025-06-04T15:45:52.364ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bd8e25c-ac2f-488e-86d8-4df782e8dd86", "content-length": "26", "date": "Wed, 04 Jun 2025 15:45:52 GMT"} })
9212025-06-04T15:45:52.364ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:673 sled = http://[fd00:1122:3344:101::1]:12345
9222025-06-04T15:45:52.366ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 609.895739ms iteration = 3 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":3,"put_config_err":0,"put_config_ok":3,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"e751cd2d-7b1b-4ea0-8b5a-62525772a5f5","time":"2025-06-04T15:35:52.240654407Z"},{"operation":"list","target_sled":"e751cd2d-7b1b-4ea0-8b5a-62525772a5f5","time":"2025-06-04T15:35:52.240920310Z"},{"generation":1,"operation":"put_config","target_sled":"e751cd2d-7b1b-4ea0-8b5a-62525772a5f5","time":"2025-06-04T15:40:52.448226065Z"},{"operation":"list","target_sled":"e751cd2d-7b1b-4ea0-8b5a-62525772a5f5","time":"2025-06-04T15:40:52.448437388Z"},{"generation":1,"operation":"put_config","target_sled":"e751cd2d-7b1b-4ea0-8b5a-62525772a5f5","time":"2025-06-04T15:45:52.364559805Z"},{"operation":"list","target_sled":"e751cd2d-7b1b-4ea0-8b5a-62525772a5f5","time":"2025-06-04T15:45:52.364815925Z"}]}
9232025-06-04T15:45:52.371ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
9242025-06-04T15:45:52.371ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
9252025-06-04T15:45:52.372ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9604b04d-ac65-48b2-a123-20fbd9ade9dd", "date": "Wed, 04 Jun 2025 15:45:51 GMT"} })
9262025-06-04T15:45:52.372ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9272025-06-04T15:45:52.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9282025-06-04T15:45:52.375ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9292025-06-04T15:45:52.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9302025-06-04T15:45:52.376ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9312025-06-04T15:45:52.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9322025-06-04T15:45:52.378ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9332025-06-04T15:45:52.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9342025-06-04T15:45:52.378ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9352025-06-04T15:45:52.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9362025-06-04T15:45:52.380ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9372025-06-04T15:45:52.381ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
9382025-06-04T15:45:52.381ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9392025-06-04T15:45:52.381ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "384a18a5-bae5-4ff3-9465-648c957490e8", "date": "Wed, 04 Jun 2025 15:45:51 GMT"} })
9402025-06-04T15:45:52.382ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 634.456411ms iteration = 21 status = {}
9412025-06-04T15:45:52.384ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
9422025-06-04T15:45:52.384ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9432025-06-04T15:45:52.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9442025-06-04T15:45:52.388ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9452025-06-04T15:45:52.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9462025-06-04T15:45:52.390ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9472025-06-04T15:45:52.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9482025-06-04T15:45:52.392ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9492025-06-04T15:45:52.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9502025-06-04T15:45:52.393ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9512025-06-04T15:45:52.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9522025-06-04T15:45:52.396ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9532025-06-04T15:45:52.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9542025-06-04T15:45:52.398ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9552025-06-04T15:45:52.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9562025-06-04T15:45:52.401ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
9572025-06-04T15:45:52.401ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "84d24a56-ca8b-4bf3-a5b1-88689c68023c", "date": "Wed, 04 Jun 2025 15:45:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
9582025-06-04T15:45:52.401ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
9592025-06-04T15:45:52.403ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5f854f73-f004-42a8-88b3-4affcbb4f036", "date": "Wed, 04 Jun 2025 15:45:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
9602025-06-04T15:45:52.403ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
9612025-06-04T15:45:52.405ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
9622025-06-04T15:45:52.405ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 660.033566ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
9632025-06-04T15:45:52.414ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
9642025-06-04T15:45:52.473ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
9652025-06-04T15:45:52.474ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5878236f-95be-4be5-aae3-fde3c0dae073", "content-length": "691", "date": "Wed, 04 Jun 2025 15:45:51 GMT"} })
9662025-06-04T15:45:52.474ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
9672025-06-04T15:45:52.474ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
9682025-06-04T15:45:52.474ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
9692025-06-04T15:45:52.475ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9702025-06-04T15:45:52.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9712025-06-04T15:45:52.476ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 728.305155ms iteration = 21 status = {}
9722025-06-04T15:45:52.479ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9732025-06-04T15:45:52.484ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
9742025-06-04T15:45:52.484ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9752025-06-04T15:45:52.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9762025-06-04T15:45:52.491ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
9772025-06-04T15:45:52.492ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "38942b58-6d97-429b-b5b4-e3331d1c48c4", "date": "Wed, 04 Jun 2025 15:45:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
9782025-06-04T15:45:52.492ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
9792025-06-04T15:45:52.494ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f5eca1cf-4787-41bf-9e8a-3dad4eb8589e", "date": "Wed, 04 Jun 2025 15:45:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
9802025-06-04T15:45:52.494ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
9812025-06-04T15:45:52.496ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9822025-06-04T15:45:52.496ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "80e9cab9-8cc9-4b9e-bce4-1921688ac6ba", "date": "Wed, 04 Jun 2025 15:45:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
9832025-06-04T15:45:52.496ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
9842025-06-04T15:45:52.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9852025-06-04T15:45:52.498ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
9862025-06-04T15:45:52.498ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 752.790856ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
9872025-06-04T15:45:52.498ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 8dbb977a-0cb9-4cf4-916b-4e19edd41b70, rack_id: 2302d566-cff7-41c0-b6e9-4f6ac6057661, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(aeecc71f-0b8d-4aaf-8e0e-04ee00063f7a) } rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0
9882025-06-04T15:45:52.498ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9892025-06-04T15:45:52.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9902025-06-04T15:45:52.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 618a04c6-f4ca-432d-a621-7e57eee5fdc5 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
9912025-06-04T15:45:52.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 618a04c6-f4ca-432d-a621-7e57eee5fdc5 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
9922025-06-04T15:45:52.511ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
9932025-06-04T15:45:52.511ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = aeecc71f-0b8d-4aaf-8e0e-04ee00063f7a
9942025-06-04T15:45:52.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 618a04c6-f4ca-432d-a621-7e57eee5fdc5 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
9952025-06-04T15:45:52.511ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
9962025-06-04T15:45:52.511ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
9972025-06-04T15:45:52.511ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9982025-06-04T15:45:52.512ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
9992025-06-04T15:45:52.512ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10002025-06-04T15:45:52.512ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
10012025-06-04T15:45:52.512ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10022025-06-04T15:45:52.512ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
10032025-06-04T15:45:52.512ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
10042025-06-04T15:45:52.512ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10052025-06-04T15:45:52.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10062025-06-04T15:45:52.515ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0
10072025-06-04T15:45:52.515ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
10082025-06-04T15:45:52.519ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10092025-06-04T15:45:52.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10102025-06-04T15:45:52.521ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10112025-06-04T15:45:52.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10122025-06-04T15:45:52.524ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10132025-06-04T15:45:52.528ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
10142025-06-04T15:45:52.528ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10152025-06-04T15:45:52.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10162025-06-04T15:45:52.543ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 10b0c705-4d8e-4d51-bb19-677beab0068d, kind: Service { id: 543f2cf1-864a-4cc8-86a9-4279c52d053c }, name: Name("nexus-543f2cf1-864a-4cc8-86a9-4279c52d053c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 189])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d8351219-a147-42d5-b119-bf9346e4a16f, kind: Service { id: 753f2fd8-42b8-4240-8646-4c4baf5591e2 }, name: Name("nexus-753f2fd8-42b8-4240-8646-4c4baf5591e2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e43cef14-db85-4ea2-b9ec-0b71960369e3, kind: Service { id: 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c }, name: Name("nexus-782c9d57-577a-4c4a-8fb7-eecc1ae29e1c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 389072d3-5513-4141-a60f-4942292c83e8, kind: Service { id: 84104d89-910f-45b9-adb6-d23a6d4f41d6 }, name: Name("external-dns-84104d89-910f-45b9-adb6-d23a6d4f41d6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 25])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fff3c2f8-b8b3-4438-8046-e8a2a3a5c986, kind: Service { id: 74458287-879a-4471-829f-da352f40aff2 }, name: Name("external-dns-74458287-879a-4471-829f-da352f40aff2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 57])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
10172025-06-04T15:45:52.543ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10182025-06-04T15:45:52.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10192025-06-04T15:45:52.545ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10202025-06-04T15:45:52.548ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
10212025-06-04T15:45:52.548ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10222025-06-04T15:45:52.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10232025-06-04T15:45:52.549ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
10242025-06-04T15:45:52.550ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 389072d3-5513-4141-a60f-4942292c83e8, kind: Service { id: 84104d89-910f-45b9-adb6-d23a6d4f41d6 }, name: Name("external-dns-84104d89-910f-45b9-adb6-d23a6d4f41d6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 25])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fff3c2f8-b8b3-4438-8046-e8a2a3a5c986, kind: Service { id: 74458287-879a-4471-829f-da352f40aff2 }, name: Name("external-dns-74458287-879a-4471-829f-da352f40aff2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 57])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 10b0c705-4d8e-4d51-bb19-677beab0068d, kind: Service { id: 543f2cf1-864a-4cc8-86a9-4279c52d053c }, name: Name("nexus-543f2cf1-864a-4cc8-86a9-4279c52d053c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 189])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d8351219-a147-42d5-b119-bf9346e4a16f, kind: Service { id: 753f2fd8-42b8-4240-8646-4c4baf5591e2 }, name: Name("nexus-753f2fd8-42b8-4240-8646-4c4baf5591e2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e43cef14-db85-4ea2-b9ec-0b71960369e3, kind: Service { id: 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c }, name: Name("nexus-782c9d57-577a-4c4a-8fb7-eecc1ae29e1c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
10252025-06-04T15:45:52.550ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
10262025-06-04T15:45:52.662ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "191c74dc-f52f-4c1e-abf4-e71a46f476d8", "date": "Wed, 04 Jun 2025 15:45:51 GMT"} })
10272025-06-04T15:45:52.663ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch = Switch0
10282025-06-04T15:45:52.663ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
10292025-06-04T15:45:52.663ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4e576e4-8311-45ce-80ae-0652426bac65", "content-length": "682", "date": "Wed, 04 Jun 2025 15:45:52 GMT"} })
10302025-06-04T15:45:52.663ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10312025-06-04T15:45:52.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10322025-06-04T15:45:52.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10332025-06-04T15:45:52.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10342025-06-04T15:45:52.671ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10352025-06-04T15:45:52.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10362025-06-04T15:45:52.674ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10372025-06-04T15:45:52.674ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: e751cd2d-7b1b-4ea0-8b5a-62525772a5f5, time_created: 2025-06-04T15:35:45.830825Z, time_modified: 2025-06-04T15:35:45.830825Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 2302d566-cff7-41c0-b6e9-4f6ac6057661, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(56094621696)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
10382025-06-04T15:45:52.674ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
10392025-06-04T15:45:52.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10402025-06-04T15:45:52.684ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 936.471254ms iteration = 21 status = {}
10412025-06-04T15:45:52.704ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10422025-06-04T15:45:52.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10432025-06-04T15:45:52.706ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10442025-06-04T15:45:52.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10452025-06-04T15:45:52.708ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10462025-06-04T15:45:52.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: e751cd2d-7b1b-4ea0-8b5a-62525772a5f5, lookup_type: ById(e751cd2d-7b1b-4ea0-8b5a-62525772a5f5) } result = Ok(())
10472025-06-04T15:45:52.711ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
10482025-06-04T15:45:52.711ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "d55a1b7f-917a-4c2c-9ff5-5cfc3c7f17d9", "date": "Wed, 04 Jun 2025 15:45:52 GMT"} })
10492025-06-04T15:45:52.712ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:495
10502025-06-04T15:45:52.712ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 964.189425ms
10512025-06-04T15:45:52.712ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 964.196615ms iteration = 3 status = {}
10522025-06-04T15:45:53.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d51bb331-c336-47d8-96bd-3d233c0cb86c roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
10532025-06-04T15:45:53.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d51bb331-c336-47d8-96bd-3d233c0cb86c resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
10542025-06-04T15:45:53.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d51bb331-c336-47d8-96bd-3d233c0cb86c response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
10552025-06-04T15:45:53.794ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
10562025-06-04T15:45:53.794ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10572025-06-04T15:45:53.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10582025-06-04T15:45:53.796ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10592025-06-04T15:45:53.798ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
10602025-06-04T15:45:53.798ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10612025-06-04T15:45:53.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10622025-06-04T15:45:53.806ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(144b5543-d583-47b8-9ca5-72e684a6d9f3, 0), (62905021-f6b0-49cb-b30a-3363fe49c5b4, 0), (0fa536fb-5bd1-429d-8d58-e5d8db638da6, 0), (9de466b2-2c67-443d-8ed1-adbd05371359, 0)] collection_id = 144b5543-d583-47b8-9ca5-72e684a6d9f3
10632025-06-04T15:45:53.806ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10642025-06-04T15:45:53.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10652025-06-04T15:45:53.897ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 144b5543-d583-47b8-9ca5-72e684a6d9f3 file = nexus/db-queries/src/db/datastore/inventory.rs:1705 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nlast_reconciliation_dataset_results = 0 nlast_reconciliation_disk_results = 0 nlast_reconciliation_zone_results = 0 nnvme_disk_firmware = 11 nomicron_sled_config_datasets = 66 nomicron_sled_config_disks = 9 nomicron_sled_config_zone_nics = 6 nomicron_sled_config_zones = 28 nomicron_sled_configs = 1 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agents = 1 nsps = 2 nzpools = 9
10662025-06-04T15:45:53.897ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10672025-06-04T15:45:53.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10682025-06-04T15:45:53.900ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(62905021-f6b0-49cb-b30a-3363fe49c5b4, 0), (0fa536fb-5bd1-429d-8d58-e5d8db638da6, 0), (9de466b2-2c67-443d-8ed1-adbd05371359, 0), (e89daccc-4e85-40bd-ae9c-15379c8f8d1a, 0)] collection_id = 62905021-f6b0-49cb-b30a-3363fe49c5b4
10692025-06-04T15:45:53.900ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10702025-06-04T15:45:53.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10712025-06-04T15:45:53.965ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 62905021-f6b0-49cb-b30a-3363fe49c5b4 file = nexus/db-queries/src/db/datastore/inventory.rs:1705 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nlast_reconciliation_dataset_results = 0 nlast_reconciliation_disk_results = 0 nlast_reconciliation_zone_results = 0 nnvme_disk_firmware = 11 nomicron_sled_config_datasets = 66 nomicron_sled_config_disks = 9 nomicron_sled_config_zone_nics = 6 nomicron_sled_config_zones = 28 nomicron_sled_configs = 1 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agents = 1 nsps = 2 nzpools = 9
10722025-06-04T15:45:53.965ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10732025-06-04T15:45:53.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10742025-06-04T15:45:53.969ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(0fa536fb-5bd1-429d-8d58-e5d8db638da6, 0), (9de466b2-2c67-443d-8ed1-adbd05371359, 0), (e89daccc-4e85-40bd-ae9c-15379c8f8d1a, 0)]
10752025-06-04T15:45:53.970ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1922, tv_nsec: 112351909 } })
10762025-06-04T15:45:54.000ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
10772025-06-04T15:45:54.000ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
10782025-06-04T15:45:54.000ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
10792025-06-04T15:45:54.001ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9175b20-2fea-4861-b96c-493f398d7ed0", "content-length": "476", "date": "Wed, 04 Jun 2025 15:45:54 GMT"} })
10802025-06-04T15:45:54.001ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
10812025-06-04T15:45:54.001ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b009f153-0703-43bf-b49b-0bafe394822b", "content-length": "734", "date": "Wed, 04 Jun 2025 15:45:54 GMT"} })
10822025-06-04T15:45:54.001ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
10832025-06-04T15:45:54.001ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4befced5-b9ca-4c46-bba3-44a7d372384d", "content-length": "111", "date": "Wed, 04 Jun 2025 15:45:54 GMT"} })
10842025-06-04T15:45:54.001ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
10852025-06-04T15:45:54.001ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f71c1cac-2ada-4e7f-86be-24ab4bb8410b", "content-length": "111", "date": "Wed, 04 Jun 2025 15:45:54 GMT"} })
10862025-06-04T15:45:54.001ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
10872025-06-04T15:45:54.002ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "953a93f9-92ec-4966-bb5c-8bbd9499d80e", "content-length": "170", "date": "Wed, 04 Jun 2025 15:45:54 GMT"} })
10882025-06-04T15:45:54.002ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
10892025-06-04T15:45:54.002ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e65e317b-9852-47b2-afc0-073e03b8639d", "content-length": "170", "date": "Wed, 04 Jun 2025 15:45:54 GMT"} })
10902025-06-04T15:45:54.002ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
10912025-06-04T15:45:54.002ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "58a9616c-f1f9-4b39-9246-bb2def52dde7", "content-length": "179", "date": "Wed, 04 Jun 2025 15:45:54 GMT"} })
10922025-06-04T15:45:54.002ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
10932025-06-04T15:45:54.002ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "515aca00-9191-480f-8dc3-e8f1b3667071", "content-length": "179", "date": "Wed, 04 Jun 2025 15:45:54 GMT"} })
10942025-06-04T15:45:54.002ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
10952025-06-04T15:45:54.002ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7a40d49-2fa2-4c95-a25b-857851dea780", "content-length": "702", "date": "Wed, 04 Jun 2025 15:45:54 GMT"} })
10962025-06-04T15:45:54.003ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
10972025-06-04T15:45:54.003ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "76c3c551-c8bd-4590-99fe-5098899ec24d", "content-length": "727", "date": "Wed, 04 Jun 2025 15:45:54 GMT"} })
10982025-06-04T15:45:54.003ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
10992025-06-04T15:45:54.003ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "01132134-da07-4408-9d9a-ee58350ef0ed", "content-length": "729", "date": "Wed, 04 Jun 2025 15:45:54 GMT"} })
11002025-06-04T15:45:54.003ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
11012025-06-04T15:45:54.003ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "88b1bf1f-a277-4223-9d26-99581f870427", "content-length": "728", "date": "Wed, 04 Jun 2025 15:45:54 GMT"} })
11022025-06-04T15:45:54.003ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
11032025-06-04T15:45:54.003ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a8723b9-348a-4663-a140-03c2c550cbcc", "content-length": "722", "date": "Wed, 04 Jun 2025 15:45:54 GMT"} })
11042025-06-04T15:45:54.003ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
11052025-06-04T15:45:54.003ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "26b8dc13-0532-4102-9474-4bca4ba201e4", "content-length": "109", "date": "Wed, 04 Jun 2025 15:45:54 GMT"} })
11062025-06-04T15:45:54.004ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
11072025-06-04T15:45:54.004ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec77b70e-a6d3-4294-9f10-aff4f9d8fb42", "content-length": "109", "date": "Wed, 04 Jun 2025 15:45:54 GMT"} })
11082025-06-04T15:45:54.004ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
11092025-06-04T15:45:54.004ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "75e323a2-ea1c-445e-a255-9ddfeb938a30", "content-length": "169", "date": "Wed, 04 Jun 2025 15:45:54 GMT"} })
11102025-06-04T15:45:54.004ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
11112025-06-04T15:45:54.004ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d931d7cb-bd2e-4192-8ba3-282f98669256", "content-length": "169", "date": "Wed, 04 Jun 2025 15:45:54 GMT"} })
11122025-06-04T15:45:54.004ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
11132025-06-04T15:45:54.004ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "94665bcb-28c3-4fa3-843c-ff539a99f70d", "content-length": "178", "date": "Wed, 04 Jun 2025 15:45:54 GMT"} })
11142025-06-04T15:45:54.004ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
11152025-06-04T15:45:54.005ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "843f5b0e-0625-4d76-82ce-2ed6141173c9", "content-length": "178", "date": "Wed, 04 Jun 2025 15:45:54 GMT"} })
11162025-06-04T15:45:54.005ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
11172025-06-04T15:45:54.005ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b985adbd-78dd-4ff6-93ed-3969e161fd29", "content-length": "702", "date": "Wed, 04 Jun 2025 15:45:54 GMT"} })
11182025-06-04T15:45:54.005ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
11192025-06-04T15:45:54.005ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c2f1476-0f9e-42c0-be4c-7d4455a86aa3", "content-length": "727", "date": "Wed, 04 Jun 2025 15:45:54 GMT"} })
11202025-06-04T15:45:54.005ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
11212025-06-04T15:45:54.005ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6586c57-7e15-4f20-93dd-45be1db2f18f", "content-length": "729", "date": "Wed, 04 Jun 2025 15:45:54 GMT"} })
11222025-06-04T15:45:54.005ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
11232025-06-04T15:45:54.005ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "33d59d65-b47c-41a2-ac6d-a8d47be703bc", "content-length": "728", "date": "Wed, 04 Jun 2025 15:45:54 GMT"} })
11242025-06-04T15:45:54.005ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
11252025-06-04T15:45:54.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
11262025-06-04T15:45:54.007ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11272025-06-04T15:45:54.009ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
11282025-06-04T15:45:54.009ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
11292025-06-04T15:45:54.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
11302025-06-04T15:45:54.011ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11312025-06-04T15:45:54.013ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
11322025-06-04T15:45:54.013ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
11332025-06-04T15:45:54.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
11342025-06-04T15:45:54.046ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
11352025-06-04T15:45:54.046ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
11362025-06-04T15:45:54.184ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "484bfdc2-4891-4ee1-bcb9-76e631627ed0", "content-length": "51808", "date": "Wed, 04 Jun 2025 15:45:54 GMT"} })
11372025-06-04T15:45:54.187ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
11382025-06-04T15:45:54.187ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
11392025-06-04T15:45:54.187ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
11402025-06-04T15:45:54.188ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
11412025-06-04T15:45:54.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
11422025-06-04T15:45:54.190ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11432025-06-04T15:45:54.192ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
11442025-06-04T15:45:54.192ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
11452025-06-04T15:45:54.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
11462025-06-04T15:45:54.347ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 328f619d-ccbe-4d07-bfb3-837f64d406d2 file = nexus/db-queries/src/db/datastore/inventory.rs:1192
11472025-06-04T15:45:54.347ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 328f619d-ccbe-4d07-bfb3-837f64d406d2 time_started = 2025-06-04 15:45:54.000637 UTC
11482025-06-04T15:45:54.347ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 6 reason = Dependency
11492025-06-04T15:45:54.347ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 552.519494ms iteration = 3 status = {"collection_id":"328f619d-ccbe-4d07-bfb3-837f64d406d2","time_done":"2025-06-04 15:45:54.187070 UTC","time_started":"2025-06-04 15:45:54.000637 UTC"}
11502025-06-04T15:45:54.347ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
11512025-06-04T15:45:54.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
11522025-06-04T15:45:54.347ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11532025-06-04T15:45:54.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
11542025-06-04T15:45:54.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11552025-06-04T15:45:54.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11562025-06-04T15:45:54.349ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11572025-06-04T15:45:54.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11582025-06-04T15:45:54.353ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11592025-06-04T15:45:54.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11602025-06-04T15:45:54.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
11612025-06-04T15:45:54.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
11622025-06-04T15:45:54.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
11632025-06-04T15:45:54.356ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11642025-06-04T15:45:54.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11652025-06-04T15:45:54.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
11662025-06-04T15:45:54.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
11672025-06-04T15:45:54.358ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11682025-06-04T15:45:54.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11692025-06-04T15:45:54.361ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11702025-06-04T15:45:54.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11712025-06-04T15:45:54.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
11722025-06-04T15:45:54.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
11732025-06-04T15:45:54.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11742025-06-04T15:45:54.401ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 54.720003ms iteration = 24 status = {"physical_disks_added":0}
11752025-06-04T15:45:54.402ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
11762025-06-04T15:45:54.402ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
11772025-06-04T15:45:54.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
11782025-06-04T15:45:54.404ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11792025-06-04T15:45:54.405ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
11802025-06-04T15:45:54.405ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
11812025-06-04T15:45:54.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
11822025-06-04T15:45:54.408ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
11832025-06-04T15:45:54.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
11842025-06-04T15:45:54.409ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11852025-06-04T15:45:54.411ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
11862025-06-04T15:45:54.411ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
11872025-06-04T15:45:54.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
11882025-06-04T15:45:54.413ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11892025-06-04T15:45:54.415ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
11902025-06-04T15:45:54.415ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
11912025-06-04T15:45:54.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
11922025-06-04T15:45:54.417ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
11932025-06-04T15:45:54.417ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 70.406906ms iteration = 6 status = {"blueprint_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","inventory_collection_id":"328f619d-ccbe-4d07-bfb3-837f64d406d2","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
11942025-06-04T15:45:54.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ea5e3342-6c0a-4684-86d5-45258e6064ee roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
11952025-06-04T15:45:54.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ea5e3342-6c0a-4684-86d5-45258e6064ee resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
11962025-06-04T15:45:54.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ea5e3342-6c0a-4684-86d5-45258e6064ee response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
11972025-06-04T15:45:55.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0c64ed27-3afa-48bc-aa2f-e27151f5ac80 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
11982025-06-04T15:45:55.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0c64ed27-3afa-48bc-aa2f-e27151f5ac80 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
11992025-06-04T15:45:55.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2646 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0c64ed27-3afa-48bc-aa2f-e27151f5ac80 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12002025-06-04T15:45:56.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = af8ea890-b6f2-463f-9502-5bd129169379 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12012025-06-04T15:45:56.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = af8ea890-b6f2-463f-9502-5bd129169379 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12022025-06-04T15:45:56.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = af8ea890-b6f2-463f-9502-5bd129169379 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12032025-06-04T15:45:57.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2f3cbd3d-0cc5-44a0-b3bc-de1634a557a3 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12042025-06-04T15:45:57.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2f3cbd3d-0cc5-44a0-b3bc-de1634a557a3 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12052025-06-04T15:45:57.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2f3cbd3d-0cc5-44a0-b3bc-de1634a557a3 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12062025-06-04T15:45:58.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4f2355ce-7299-40d0-b74f-c7c2a08e4afa roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12072025-06-04T15:45:58.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4f2355ce-7299-40d0-b74f-c7c2a08e4afa resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12082025-06-04T15:45:58.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2493 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4f2355ce-7299-40d0-b74f-c7c2a08e4afa response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12092025-06-04T15:45:59.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = afc6d1d1-93d2-4817-9466-0d3d460b88d6 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12102025-06-04T15:45:59.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = afc6d1d1-93d2-4817-9466-0d3d460b88d6 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12112025-06-04T15:45:59.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = afc6d1d1-93d2-4817-9466-0d3d460b88d6 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12122025-06-04T15:45:59.949ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 523 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = 40cd9299-2681-490d-b51b-3441e9769efd response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
12132025-06-04T15:46:00.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6a01a4d3-be40-412f-b18e-b11292e3fe54 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12142025-06-04T15:46:00.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6a01a4d3-be40-412f-b18e-b11292e3fe54 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12152025-06-04T15:46:00.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2378 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6a01a4d3-be40-412f-b18e-b11292e3fe54 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12162025-06-04T15:46:01.747ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
12172025-06-04T15:46:01.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12182025-06-04T15:46:01.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12192025-06-04T15:46:01.748ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
12202025-06-04T15:46:01.748ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12212025-06-04T15:46:01.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12222025-06-04T15:46:01.750ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12232025-06-04T15:46:01.751ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12242025-06-04T15:46:01.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12252025-06-04T15:46:01.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12262025-06-04T15:46:01.753ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12272025-06-04T15:46:01.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12282025-06-04T15:46:01.755ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12292025-06-04T15:46:01.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12302025-06-04T15:46:01.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12312025-06-04T15:46:01.759ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
12322025-06-04T15:46:01.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12332025-06-04T15:46:01.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12342025-06-04T15:46:01.774ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
12352025-06-04T15:46:01.774ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.974021ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
12362025-06-04T15:46:01.791ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.195941ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12372025-06-04T15:46:01.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f42ea5c2-40bf-476c-bb75-d979de686780 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12382025-06-04T15:46:01.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f42ea5c2-40bf-476c-bb75-d979de686780 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12392025-06-04T15:46:01.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1938 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f42ea5c2-40bf-476c-bb75-d979de686780 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12402025-06-04T15:46:02.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ab08b83d-3000-4c3b-9f36-94996efd4342 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12412025-06-04T15:46:02.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ab08b83d-3000-4c3b-9f36-94996efd4342 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12422025-06-04T15:46:02.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ab08b83d-3000-4c3b-9f36-94996efd4342 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12432025-06-04T15:46:03.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 81599d62-d6e7-488e-baa9-05f5e27ad6ca roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12442025-06-04T15:46:03.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 81599d62-d6e7-488e-baa9-05f5e27ad6ca resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12452025-06-04T15:46:03.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 81599d62-d6e7-488e-baa9-05f5e27ad6ca response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12462025-06-04T15:46:04.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9608bc1e-1b7e-467b-9fc9-b5139edf01e7 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12472025-06-04T15:46:04.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9608bc1e-1b7e-467b-9fc9-b5139edf01e7 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12482025-06-04T15:46:04.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2077 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9608bc1e-1b7e-467b-9fc9-b5139edf01e7 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12492025-06-04T15:46:05.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 495c0db9-ec78-402e-895d-163c924d7cf5 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12502025-06-04T15:46:05.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 495c0db9-ec78-402e-895d-163c924d7cf5 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12512025-06-04T15:46:05.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 495c0db9-ec78-402e-895d-163c924d7cf5 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12522025-06-04T15:46:06.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5fe228df-b1c8-4f4b-b41a-8499de0255a6 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12532025-06-04T15:46:06.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5fe228df-b1c8-4f4b-b41a-8499de0255a6 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12542025-06-04T15:46:06.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5fe228df-b1c8-4f4b-b41a-8499de0255a6 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12552025-06-04T15:46:07.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 00ec7f13-218b-4661-b675-28b9c4d11565 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12562025-06-04T15:46:07.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 00ec7f13-218b-4661-b675-28b9c4d11565 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12572025-06-04T15:46:07.890ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2024 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 00ec7f13-218b-4661-b675-28b9c4d11565 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12582025-06-04T15:46:08.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e36031e5-7aa4-4e15-a970-d85c6f39c59f roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12592025-06-04T15:46:08.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e36031e5-7aa4-4e15-a970-d85c6f39c59f resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12602025-06-04T15:46:08.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e36031e5-7aa4-4e15-a970-d85c6f39c59f response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12612025-06-04T15:46:09.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = af1e9233-dfad-46b8-b553-4dd0873e69b4 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12622025-06-04T15:46:09.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = af1e9233-dfad-46b8-b553-4dd0873e69b4 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12632025-06-04T15:46:09.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2456 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = af1e9233-dfad-46b8-b553-4dd0873e69b4 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12642025-06-04T15:46:09.949ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 484 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = 3011d9cd-dd78-40fa-92d5-d85e3edd7ce2 response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
12652025-06-04T15:46:10.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 28b122c9-15f1-4465-9911-cee889d504b8 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12662025-06-04T15:46:10.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 28b122c9-15f1-4465-9911-cee889d504b8 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12672025-06-04T15:46:10.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1841 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 28b122c9-15f1-4465-9911-cee889d504b8 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12682025-06-04T15:46:11.748ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
12692025-06-04T15:46:11.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12702025-06-04T15:46:11.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12712025-06-04T15:46:11.748ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
12722025-06-04T15:46:11.748ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12732025-06-04T15:46:11.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12742025-06-04T15:46:11.750ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12752025-06-04T15:46:11.750ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12762025-06-04T15:46:11.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12772025-06-04T15:46:11.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12782025-06-04T15:46:11.753ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12792025-06-04T15:46:11.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12802025-06-04T15:46:11.755ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12812025-06-04T15:46:11.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12822025-06-04T15:46:11.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12832025-06-04T15:46:11.759ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
12842025-06-04T15:46:11.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12852025-06-04T15:46:11.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12862025-06-04T15:46:11.771ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
12872025-06-04T15:46:11.771ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.183516ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
12882025-06-04T15:46:11.785ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.628281ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12892025-06-04T15:46:11.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8f985ac2-a405-4c6f-b801-be8c477f8289 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12902025-06-04T15:46:11.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8f985ac2-a405-4c6f-b801-be8c477f8289 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12912025-06-04T15:46:11.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8f985ac2-a405-4c6f-b801-be8c477f8289 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12922025-06-04T15:46:12.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6a4eee48-6ee1-4cf8-89a2-459cbb765e56 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12932025-06-04T15:46:12.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6a4eee48-6ee1-4cf8-89a2-459cbb765e56 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12942025-06-04T15:46:12.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6a4eee48-6ee1-4cf8-89a2-459cbb765e56 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12952025-06-04T15:46:13.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 92681fc7-1435-4561-969f-18dc1e39bfe0 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12962025-06-04T15:46:13.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 92681fc7-1435-4561-969f-18dc1e39bfe0 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12972025-06-04T15:46:13.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 92681fc7-1435-4561-969f-18dc1e39bfe0 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12982025-06-04T15:46:15.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b30ad9d3-cde4-451a-a132-a1cd4b9d93af roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
12992025-06-04T15:46:15.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b30ad9d3-cde4-451a-a132-a1cd4b9d93af resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
13002025-06-04T15:46:15.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3024 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b30ad9d3-cde4-451a-a132-a1cd4b9d93af response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
13012025-06-04T15:46:16.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 080a616d-fec4-4d64-aabe-7a0aea80c7d2 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
13022025-06-04T15:46:16.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 080a616d-fec4-4d64-aabe-7a0aea80c7d2 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
13032025-06-04T15:46:16.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 5299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 080a616d-fec4-4d64-aabe-7a0aea80c7d2 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
13042025-06-04T15:46:17.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 73713630-04af-42e0-a02b-f5af6ab1ba66 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
13052025-06-04T15:46:17.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 73713630-04af-42e0-a02b-f5af6ab1ba66 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
13062025-06-04T15:46:17.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 73713630-04af-42e0-a02b-f5af6ab1ba66 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
13072025-06-04T15:46:18.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f53fa1b9-7a65-44d9-884d-f0749dd4eeaf roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
13082025-06-04T15:46:18.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f53fa1b9-7a65-44d9-884d-f0749dd4eeaf resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
13092025-06-04T15:46:18.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2471 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f53fa1b9-7a65-44d9-884d-f0749dd4eeaf response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
13102025-06-04T15:46:19.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ef9d434a-504c-48d3-bb7d-b3c1cfbf6f8a roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
13112025-06-04T15:46:19.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ef9d434a-504c-48d3-bb7d-b3c1cfbf6f8a resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
13122025-06-04T15:46:19.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2740 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ef9d434a-504c-48d3-bb7d-b3c1cfbf6f8a response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
13132025-06-04T15:46:19.949ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 621 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = 01640415-4dc8-41ff-9b08-9e5ce27c6237 response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
13142025-06-04T15:46:20.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 13c6cb9e-4b68-4d3b-84b5-5929f040b98b roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
13152025-06-04T15:46:20.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 13c6cb9e-4b68-4d3b-84b5-5929f040b98b resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
13162025-06-04T15:46:20.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 13c6cb9e-4b68-4d3b-84b5-5929f040b98b response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
13172025-06-04T15:46:21.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b7923566-7f61-41f7-bacb-5cf46233c822 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
13182025-06-04T15:46:21.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b7923566-7f61-41f7-bacb-5cf46233c822 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
13192025-06-04T15:46:21.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b7923566-7f61-41f7-bacb-5cf46233c822 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
13202025-06-04T15:46:21.745ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
13212025-06-04T15:46:21.745ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
13222025-06-04T15:46:21.745ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13232025-06-04T15:46:21.745ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13242025-06-04T15:46:21.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13252025-06-04T15:46:21.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
13262025-06-04T15:46:21.747ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
13272025-06-04T15:46:21.748ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 22 reason = Timeout
13282025-06-04T15:46:21.748ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
13292025-06-04T15:46:21.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13302025-06-04T15:46:21.748ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13312025-06-04T15:46:21.748ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
13322025-06-04T15:46:21.748ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
13332025-06-04T15:46:21.748ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13342025-06-04T15:46:21.748ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
13352025-06-04T15:46:21.748ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13362025-06-04T15:46:21.748ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13372025-06-04T15:46:21.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13382025-06-04T15:46:21.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13392025-06-04T15:46:21.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13402025-06-04T15:46:21.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13412025-06-04T15:46:21.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13422025-06-04T15:46:21.748ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
13432025-06-04T15:46:21.748ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
13442025-06-04T15:46:21.748ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
13452025-06-04T15:46:21.748ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13462025-06-04T15:46:21.748ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
13472025-06-04T15:46:21.748ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13482025-06-04T15:46:21.748ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13492025-06-04T15:46:21.748ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
13502025-06-04T15:46:21.749ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13512025-06-04T15:46:21.749ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13522025-06-04T15:46:21.749ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
13532025-06-04T15:46:21.749ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13542025-06-04T15:46:21.749ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
13552025-06-04T15:46:21.749ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13562025-06-04T15:46:21.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13572025-06-04T15:46:21.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13582025-06-04T15:46:21.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13592025-06-04T15:46:21.749ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1949, tv_nsec: 890978667 } })
13602025-06-04T15:46:21.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13612025-06-04T15:46:21.749ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1949, tv_nsec: 890994277 } })
13622025-06-04T15:46:21.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13632025-06-04T15:46:21.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13642025-06-04T15:46:21.749ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
13652025-06-04T15:46:21.749ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
13662025-06-04T15:46:21.750ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13672025-06-04T15:46:21.751ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13682025-06-04T15:46:21.751ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13692025-06-04T15:46:21.751ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13702025-06-04T15:46:21.752ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.457485ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
13712025-06-04T15:46:21.752ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13722025-06-04T15:46:21.755ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
13732025-06-04T15:46:21.755ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13742025-06-04T15:46:21.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13752025-06-04T15:46:21.755ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13762025-06-04T15:46:21.755ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13772025-06-04T15:46:21.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13782025-06-04T15:46:21.755ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
13792025-06-04T15:46:21.755ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13802025-06-04T15:46:21.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13812025-06-04T15:46:21.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13822025-06-04T15:46:21.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13832025-06-04T15:46:21.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13842025-06-04T15:46:21.756ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
13852025-06-04T15:46:21.756ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
13862025-06-04T15:46:21.756ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13872025-06-04T15:46:21.756ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13882025-06-04T15:46:21.756ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
13892025-06-04T15:46:21.756ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
13902025-06-04T15:46:21.756ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
13912025-06-04T15:46:21.756ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
13922025-06-04T15:46:21.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
13932025-06-04T15:46:21.756ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13942025-06-04T15:46:21.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13952025-06-04T15:46:21.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
13962025-06-04T15:46:21.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
13972025-06-04T15:46:21.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13982025-06-04T15:46:21.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13992025-06-04T15:46:21.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14002025-06-04T15:46:21.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14012025-06-04T15:46:21.761ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 22 reason = Timeout
14022025-06-04T15:46:21.761ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
14032025-06-04T15:46:21.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
14042025-06-04T15:46:21.761ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14052025-06-04T15:46:21.761ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14062025-06-04T15:46:21.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14072025-06-04T15:46:21.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14082025-06-04T15:46:21.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14092025-06-04T15:46:21.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14102025-06-04T15:46:21.762ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14112025-06-04T15:46:21.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14122025-06-04T15:46:21.765ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14132025-06-04T15:46:21.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14142025-06-04T15:46:21.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14152025-06-04T15:46:21.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14162025-06-04T15:46:21.766ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1949, tv_nsec: 908065558 } })
14172025-06-04T15:46:21.766ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
14182025-06-04T15:46:21.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14192025-06-04T15:46:21.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14202025-06-04T15:46:21.770ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14212025-06-04T15:46:21.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14222025-06-04T15:46:21.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14232025-06-04T15:46:21.774ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14242025-06-04T15:46:21.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14252025-06-04T15:46:21.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
14262025-06-04T15:46:21.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14272025-06-04T15:46:21.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14282025-06-04T15:46:21.797ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
14292025-06-04T15:46:21.797ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.495808ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
14302025-06-04T15:46:21.808ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14312025-06-04T15:46:21.808ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
14322025-06-04T15:46:21.808ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14332025-06-04T15:46:21.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14342025-06-04T15:46:21.812ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14352025-06-04T15:46:21.812ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
14362025-06-04T15:46:21.812ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14372025-06-04T15:46:21.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14382025-06-04T15:46:21.816ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14392025-06-04T15:46:21.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14402025-06-04T15:46:21.817ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.799638ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
14412025-06-04T15:46:21.817ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14422025-06-04T15:46:21.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14432025-06-04T15:46:21.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14442025-06-04T15:46:21.818ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.938612ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
14452025-06-04T15:46:21.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14462025-06-04T15:46:21.818ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
14472025-06-04T15:46:21.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
14482025-06-04T15:46:21.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14492025-06-04T15:46:21.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14502025-06-04T15:46:21.821ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14512025-06-04T15:46:21.821ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14522025-06-04T15:46:21.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
14532025-06-04T15:46:21.824ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
14542025-06-04T15:46:21.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
14552025-06-04T15:46:21.824ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 63.898246ms iteration = 22 status = {"errors":[],"requests_created_ok":[]}
14562025-06-04T15:46:21.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e751cd2d-7b1b-4ea0-8b5a-62525772a5f5, lookup_type: ById(e751cd2d-7b1b-4ea0-8b5a-62525772a5f5) } result = Ok(())
14572025-06-04T15:46:21.825ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14582025-06-04T15:46:21.825ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
14592025-06-04T15:46:21.825ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 77.862718ms iteration = 22 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
14602025-06-04T15:46:21.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14612025-06-04T15:46:21.827ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
14622025-06-04T15:46:21.827ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 78.619467ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
14632025-06-04T15:46:21.827ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 79.790811ms iteration = 22 status = 0
14642025-06-04T15:46:21.828ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14652025-06-04T15:46:21.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14662025-06-04T15:46:21.829ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 80.080134ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14672025-06-04T15:46:21.830ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14682025-06-04T15:46:21.833ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14692025-06-04T15:46:21.833ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14702025-06-04T15:46:21.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14712025-06-04T15:46:21.840ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
14722025-06-04T15:46:21.840ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14732025-06-04T15:46:21.840ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "17b30e4d-e56b-4934-8424-9b1e69a93bf3", "content-length": "26", "date": "Wed, 04 Jun 2025 15:46:21 GMT"} })
14742025-06-04T15:46:21.840ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14752025-06-04T15:46:21.842ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14762025-06-04T15:46:21.851ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
14772025-06-04T15:46:21.851ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14782025-06-04T15:46:21.852ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "76005051-d70e-4e08-a5ed-8cd346722755", "content-length": "26", "date": "Wed, 04 Jun 2025 15:46:21 GMT"} })
14792025-06-04T15:46:21.852ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14802025-06-04T15:46:21.852ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14812025-06-04T15:46:21.852ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
14822025-06-04T15:46:21.852ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 103.798766ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
14832025-06-04T15:46:21.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14842025-06-04T15:46:21.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14852025-06-04T15:46:21.853ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14862025-06-04T15:46:21.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 107.098417ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14872025-06-04T15:46:21.858ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 zone_address = fd00:1122:3344:101::2
14882025-06-04T15:46:21.858ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14892025-06-04T15:46:21.858ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1f89b52-48e8-49d8-b97a-7ef366545fdf", "content-length": "26", "date": "Wed, 04 Jun 2025 15:46:21 GMT"} })
14902025-06-04T15:46:21.858ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14912025-06-04T15:46:21.860ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
14922025-06-04T15:46:21.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 106.822643ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14932025-06-04T15:46:21.895ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 138.211609ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
14942025-06-04T15:46:21.898ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14952025-06-04T15:46:21.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14962025-06-04T15:46:21.906ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14972025-06-04T15:46:21.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14982025-06-04T15:46:21.908ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 160.560954ms iteration = 25 status = {"physical_disks_added":0}
14992025-06-04T15:46:21.922ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15002025-06-04T15:46:21.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15012025-06-04T15:46:21.924ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 178.992241ms iteration = 22 status = null
15022025-06-04T15:46:21.940ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15032025-06-04T15:46:21.942ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15042025-06-04T15:46:21.942ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15052025-06-04T15:46:21.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15062025-06-04T15:46:21.944ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15072025-06-04T15:46:21.944ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 198.737904ms iteration = 22 status = {}
15082025-06-04T15:46:21.946ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15092025-06-04T15:46:21.946ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15102025-06-04T15:46:21.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15112025-06-04T15:46:21.966ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
15122025-06-04T15:46:21.966ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15132025-06-04T15:46:21.966ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4845dad5-de66-4d45-a310-e8b625458160", "content-length": "372", "date": "Wed, 04 Jun 2025 15:46:21 GMT"} })
15142025-06-04T15:46:21.966ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15152025-06-04T15:46:21.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15162025-06-04T15:46:21.981ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
15172025-06-04T15:46:21.981ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
15182025-06-04T15:46:21.981ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "26cb6280-4008-4cd7-85e2-241a91895c7f", "date": "Wed, 04 Jun 2025 15:46:21 GMT"} })
15192025-06-04T15:46:21.981ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15202025-06-04T15:46:21.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15212025-06-04T15:46:21.984ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15222025-06-04T15:46:21.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15232025-06-04T15:46:21.986ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15242025-06-04T15:46:21.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15252025-06-04T15:46:21.992ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
15262025-06-04T15:46:21.992ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15272025-06-04T15:46:21.992ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "68ced9c0-866b-480d-a6f2-ed6c2354f86d", "date": "Wed, 04 Jun 2025 15:46:21 GMT"} })
15282025-06-04T15:46:21.994ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 245.177985ms iteration = 22 status = {}
15292025-06-04T15:46:22.013ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15302025-06-04T15:46:22.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15312025-06-04T15:46:22.015ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 8dbb977a-0cb9-4cf4-916b-4e19edd41b70, rack_id: 2302d566-cff7-41c0-b6e9-4f6ac6057661, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(aeecc71f-0b8d-4aaf-8e0e-04ee00063f7a) } rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0
15322025-06-04T15:46:22.015ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15332025-06-04T15:46:22.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15342025-06-04T15:46:22.026ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
15352025-06-04T15:46:22.026ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = aeecc71f-0b8d-4aaf-8e0e-04ee00063f7a
15362025-06-04T15:46:22.026ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
15372025-06-04T15:46:22.026ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
15382025-06-04T15:46:22.026ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15392025-06-04T15:46:22.026ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15402025-06-04T15:46:22.026ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15412025-06-04T15:46:22.026ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15422025-06-04T15:46:22.026ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15432025-06-04T15:46:22.026ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15442025-06-04T15:46:22.026ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
15452025-06-04T15:46:22.026ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15462025-06-04T15:46:22.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15472025-06-04T15:46:22.029ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0
15482025-06-04T15:46:22.029ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
15492025-06-04T15:46:22.049ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
15502025-06-04T15:46:22.153ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "43ae08c4-2a59-4c50-af0d-e6bdc5ef48e8", "date": "Wed, 04 Jun 2025 15:46:21 GMT"} })
15512025-06-04T15:46:22.153ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch = Switch0
15522025-06-04T15:46:22.153ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
15532025-06-04T15:46:22.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5ce4b437-1053-400c-850f-db900ae04c24 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
15542025-06-04T15:46:22.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5ce4b437-1053-400c-850f-db900ae04c24 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
15552025-06-04T15:46:22.153ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7bff4f6-fddd-4f38-90ef-166b54092714", "content-length": "691", "date": "Wed, 04 Jun 2025 15:46:21 GMT"} })
15562025-06-04T15:46:22.153ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1240ff57-7b9a-42c7-924d-eb8fffd13f6d", "content-length": "682", "date": "Wed, 04 Jun 2025 15:46:21 GMT"} })
15572025-06-04T15:46:22.153ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
15582025-06-04T15:46:22.153ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
15592025-06-04T15:46:22.153ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
15602025-06-04T15:46:22.154ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15612025-06-04T15:46:22.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15622025-06-04T15:46:22.155ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 406.683461ms iteration = 22 status = {}
15632025-06-04T15:46:22.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3475 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5ce4b437-1053-400c-850f-db900ae04c24 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
15642025-06-04T15:46:22.159ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15652025-06-04T15:46:22.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15662025-06-04T15:46:22.164ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15672025-06-04T15:46:22.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15682025-06-04T15:46:22.167ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15692025-06-04T15:46:22.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15702025-06-04T15:46:22.181ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 433.630252ms iteration = 22 status = {}
15712025-06-04T15:46:23.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 67614f07-20f4-40f2-a001-364264ee041b roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
15722025-06-04T15:46:23.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 67614f07-20f4-40f2-a001-364264ee041b resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
15732025-06-04T15:46:23.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 67614f07-20f4-40f2-a001-364264ee041b response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
15742025-06-04T15:46:24.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ac5195bb-5263-43bf-be2c-2a608beb4446 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
15752025-06-04T15:46:24.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ac5195bb-5263-43bf-be2c-2a608beb4446 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
15762025-06-04T15:46:24.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ac5195bb-5263-43bf-be2c-2a608beb4446 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
15772025-06-04T15:46:25.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 41223b1a-d875-4048-9035-2c0079a2d0e8 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
15782025-06-04T15:46:25.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 41223b1a-d875-4048-9035-2c0079a2d0e8 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
15792025-06-04T15:46:25.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2707 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 41223b1a-d875-4048-9035-2c0079a2d0e8 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
15802025-06-04T15:46:26.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 040b34aa-a441-4c25-88da-f44c50422a3e roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
15812025-06-04T15:46:26.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 040b34aa-a441-4c25-88da-f44c50422a3e resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
15822025-06-04T15:46:26.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 040b34aa-a441-4c25-88da-f44c50422a3e response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
15832025-06-04T15:46:27.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4c3269bb-29e9-4b9c-8052-6bdd4a17a0c7 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
15842025-06-04T15:46:27.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4c3269bb-29e9-4b9c-8052-6bdd4a17a0c7 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
15852025-06-04T15:46:27.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2428 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4c3269bb-29e9-4b9c-8052-6bdd4a17a0c7 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
15862025-06-04T15:46:28.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f1039c3a-3338-4755-9a1c-9bb72d9b3ab5 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
15872025-06-04T15:46:28.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f1039c3a-3338-4755-9a1c-9bb72d9b3ab5 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
15882025-06-04T15:46:28.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2343 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f1039c3a-3338-4755-9a1c-9bb72d9b3ab5 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
15892025-06-04T15:46:29.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 47b1c373-4bd6-4672-b5db-c4ffeaef3138 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
15902025-06-04T15:46:29.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 47b1c373-4bd6-4672-b5db-c4ffeaef3138 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
15912025-06-04T15:46:29.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 47b1c373-4bd6-4672-b5db-c4ffeaef3138 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
15922025-06-04T15:46:29.940ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:37446
15932025-06-04T15:46:29.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37446 req_id = 70c85a35-c43f-48d9-bc56-1c1c751e16e9 roles = RoleSet { roles: {} } uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?sort_by=id_ascending
15942025-06-04T15:46:29.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37446 req_id = 70c85a35-c43f-48d9-bc56-1c1c751e16e9 resource = Database result = Ok(()) uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?sort_by=id_ascending
15952025-06-04T15:46:29.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37446 req_id = 70c85a35-c43f-48d9-bc56-1c1c751e16e9 response_code = 200 uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?sort_by=id_ascending
15962025-06-04T15:46:29.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37446 req_id = c9d67eb9-4721-4acd-8d34-7fa925ef5687 roles = RoleSet { roles: {} } uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzUxY2QyZC03YjFiLTRlYTAtOGI1YS02MjUyNTc3MmE1ZjUifX0%3D
15972025-06-04T15:46:29.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37446 req_id = c9d67eb9-4721-4acd-8d34-7fa925ef5687 resource = Database result = Ok(()) uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzUxY2QyZC03YjFiLTRlYTAtOGI1YS02MjUyNTc3MmE1ZjUifX0%3D
15982025-06-04T15:46:29.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1669 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37446 req_id = c9d67eb9-4721-4acd-8d34-7fa925ef5687 response_code = 200 uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzUxY2QyZC03YjFiLTRlYTAtOGI1YS02MjUyNTc3MmE1ZjUifX0%3D
15992025-06-04T15:46:29.949ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 458 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = 569187db-eb48-4500-9a3c-950115356490 response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
16002025-06-04T15:46:30.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4e8fc320-0461-445f-9159-d7a7d8658f30 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16012025-06-04T15:46:30.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4e8fc320-0461-445f-9159-d7a7d8658f30 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16022025-06-04T15:46:30.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2764 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4e8fc320-0461-445f-9159-d7a7d8658f30 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16032025-06-04T15:46:31.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 231441e1-4284-473f-a3b9-dc8595d29b00 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16042025-06-04T15:46:31.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 231441e1-4284-473f-a3b9-dc8595d29b00 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16052025-06-04T15:46:31.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1797 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 231441e1-4284-473f-a3b9-dc8595d29b00 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16062025-06-04T15:46:31.748ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
16072025-06-04T15:46:31.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16082025-06-04T15:46:31.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16092025-06-04T15:46:31.749ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
16102025-06-04T15:46:31.749ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16112025-06-04T15:46:31.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16122025-06-04T15:46:31.751ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16132025-06-04T15:46:31.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16142025-06-04T15:46:31.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16152025-06-04T15:46:31.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16162025-06-04T15:46:31.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16172025-06-04T15:46:31.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16182025-06-04T15:46:31.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16192025-06-04T15:46:31.761ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
16202025-06-04T15:46:31.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16212025-06-04T15:46:31.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16222025-06-04T15:46:31.774ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
16232025-06-04T15:46:31.774ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.634136ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
16242025-06-04T15:46:31.790ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16252025-06-04T15:46:31.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16262025-06-04T15:46:31.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 74.421066ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16272025-06-04T15:46:32.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a1cb8006-0768-4b02-9691-cd20e2593162 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16282025-06-04T15:46:32.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a1cb8006-0768-4b02-9691-cd20e2593162 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16292025-06-04T15:46:32.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1883 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a1cb8006-0768-4b02-9691-cd20e2593162 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16302025-06-04T15:46:33.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9ffaf5a9-9759-4c5f-aca7-a4dd90907d85 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16312025-06-04T15:46:33.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9ffaf5a9-9759-4c5f-aca7-a4dd90907d85 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16322025-06-04T15:46:33.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2702 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9ffaf5a9-9759-4c5f-aca7-a4dd90907d85 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16332025-06-04T15:46:34.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ba6e3cbf-e5b9-4609-b068-5071c62bc4d3 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16342025-06-04T15:46:34.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ba6e3cbf-e5b9-4609-b068-5071c62bc4d3 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16352025-06-04T15:46:34.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ba6e3cbf-e5b9-4609-b068-5071c62bc4d3 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16362025-06-04T15:46:35.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 42ff4259-0005-41a2-8ddb-ab280dd58420 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16372025-06-04T15:46:35.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 42ff4259-0005-41a2-8ddb-ab280dd58420 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16382025-06-04T15:46:35.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 42ff4259-0005-41a2-8ddb-ab280dd58420 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16392025-06-04T15:46:36.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 665d35e4-52f6-47c8-b788-9be4be59e068 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16402025-06-04T15:46:36.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 665d35e4-52f6-47c8-b788-9be4be59e068 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16412025-06-04T15:46:36.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1671 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 665d35e4-52f6-47c8-b788-9be4be59e068 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16422025-06-04T15:46:37.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e738c5c9-6728-4ec2-a52f-cab5a2f74ddb roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16432025-06-04T15:46:37.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e738c5c9-6728-4ec2-a52f-cab5a2f74ddb resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16442025-06-04T15:46:37.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2326 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e738c5c9-6728-4ec2-a52f-cab5a2f74ddb response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16452025-06-04T15:46:38.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 03d334c1-eed5-4cf5-a565-30df80955e3a roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16462025-06-04T15:46:38.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 03d334c1-eed5-4cf5-a565-30df80955e3a resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16472025-06-04T15:46:38.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2564 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 03d334c1-eed5-4cf5-a565-30df80955e3a response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16482025-06-04T15:46:39.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6e034c37-49c2-4153-b31e-a9b525aa6c3b roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16492025-06-04T15:46:39.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6e034c37-49c2-4153-b31e-a9b525aa6c3b resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16502025-06-04T15:46:39.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2464 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6e034c37-49c2-4153-b31e-a9b525aa6c3b response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16512025-06-04T15:46:39.949ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 477 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = c037c548-c353-4f2a-baa2-d2de8ebdf5fc response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
16522025-06-04T15:46:40.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 1ffc3fde-b1a2-4f41-bd12-980423bdb284 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16532025-06-04T15:46:40.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 1ffc3fde-b1a2-4f41-bd12-980423bdb284 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16542025-06-04T15:46:40.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 1ffc3fde-b1a2-4f41-bd12-980423bdb284 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16552025-06-04T15:46:41.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d8c7be0f-da53-41eb-966b-9c0b316c460a roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16562025-06-04T15:46:41.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d8c7be0f-da53-41eb-966b-9c0b316c460a resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16572025-06-04T15:46:41.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d8c7be0f-da53-41eb-966b-9c0b316c460a response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16582025-06-04T15:46:41.747ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
16592025-06-04T15:46:41.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16602025-06-04T15:46:41.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16612025-06-04T15:46:41.748ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
16622025-06-04T15:46:41.748ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16632025-06-04T15:46:41.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16642025-06-04T15:46:41.750ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16652025-06-04T15:46:41.750ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16662025-06-04T15:46:41.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16672025-06-04T15:46:41.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16682025-06-04T15:46:41.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16692025-06-04T15:46:41.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16702025-06-04T15:46:41.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16712025-06-04T15:46:41.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16722025-06-04T15:46:41.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16732025-06-04T15:46:41.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
16742025-06-04T15:46:41.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16752025-06-04T15:46:41.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16762025-06-04T15:46:41.769ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
16772025-06-04T15:46:41.769ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.95955ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
16782025-06-04T15:46:41.782ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.242589ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16792025-06-04T15:46:42.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d6082149-3f75-48b1-a07e-8e93020a54fa roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16802025-06-04T15:46:42.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d6082149-3f75-48b1-a07e-8e93020a54fa resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16812025-06-04T15:46:42.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d6082149-3f75-48b1-a07e-8e93020a54fa response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16822025-06-04T15:46:43.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 07d84831-a50f-4133-a412-67e2e0f5c031 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16832025-06-04T15:46:43.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 07d84831-a50f-4133-a412-67e2e0f5c031 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16842025-06-04T15:46:43.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2630 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 07d84831-a50f-4133-a412-67e2e0f5c031 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16852025-06-04T15:46:44.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 789b4962-b28b-41c9-87a1-006e0cdc513b roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16862025-06-04T15:46:44.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 789b4962-b28b-41c9-87a1-006e0cdc513b resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16872025-06-04T15:46:44.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2843 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 789b4962-b28b-41c9-87a1-006e0cdc513b response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16882025-06-04T15:46:45.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9fa8748f-4859-4287-9c5d-9c4535d4446c roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16892025-06-04T15:46:45.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9fa8748f-4859-4287-9c5d-9c4535d4446c resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16902025-06-04T15:46:45.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1620 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9fa8748f-4859-4287-9c5d-9c4535d4446c response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16912025-06-04T15:46:46.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = c747c222-3e2c-4b88-a553-adf6414e8cbb roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16922025-06-04T15:46:46.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = c747c222-3e2c-4b88-a553-adf6414e8cbb resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16932025-06-04T15:46:46.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = c747c222-3e2c-4b88-a553-adf6414e8cbb response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16942025-06-04T15:46:47.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = eaedf154-dc20-4edd-9b96-68be8de63350 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16952025-06-04T15:46:47.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = eaedf154-dc20-4edd-9b96-68be8de63350 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16962025-06-04T15:46:47.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = eaedf154-dc20-4edd-9b96-68be8de63350 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16972025-06-04T15:46:48.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2d26be18-b2ff-4c57-9eea-358cdba163cf roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16982025-06-04T15:46:48.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2d26be18-b2ff-4c57-9eea-358cdba163cf resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
16992025-06-04T15:46:48.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2483 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2d26be18-b2ff-4c57-9eea-358cdba163cf response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
17002025-06-04T15:46:49.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 60e7b050-2c69-4fad-8d86-c74d44281839 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
17012025-06-04T15:46:49.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 60e7b050-2c69-4fad-8d86-c74d44281839 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
17022025-06-04T15:46:49.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1892 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 60e7b050-2c69-4fad-8d86-c74d44281839 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
17032025-06-04T15:46:49.949ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 497 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = f1aac2dc-7711-4879-b595-10251806ef44 response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
17042025-06-04T15:46:50.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9dd17e9c-ee4d-49bd-988a-e752a56d2006 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
17052025-06-04T15:46:50.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9dd17e9c-ee4d-49bd-988a-e752a56d2006 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
17062025-06-04T15:46:50.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9dd17e9c-ee4d-49bd-988a-e752a56d2006 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
17072025-06-04T15:46:51.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = adbd9037-33bb-490f-ab3d-3cc4668b4633 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
17082025-06-04T15:46:51.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = adbd9037-33bb-490f-ab3d-3cc4668b4633 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
17092025-06-04T15:46:51.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 5452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = adbd9037-33bb-490f-ab3d-3cc4668b4633 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
17102025-06-04T15:46:51.746ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
17112025-06-04T15:46:51.746ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
17122025-06-04T15:46:51.746ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
17132025-06-04T15:46:51.746ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
17142025-06-04T15:46:51.746ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17152025-06-04T15:46:51.746ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
17162025-06-04T15:46:51.746ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
17172025-06-04T15:46:51.746ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
17182025-06-04T15:46:51.746ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-04 15:36:51.746753444 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
17192025-06-04T15:46:51.746ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
17202025-06-04T15:46:51.746ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
17212025-06-04T15:46:51.746ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
17222025-06-04T15:46:51.746ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17232025-06-04T15:46:51.746ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
17242025-06-04T15:46:51.746ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
17252025-06-04T15:46:51.746ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17262025-06-04T15:46:51.746ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
17272025-06-04T15:46:51.746ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
17282025-06-04T15:46:51.746ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17292025-06-04T15:46:51.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
17302025-06-04T15:46:51.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17312025-06-04T15:46:51.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
17322025-06-04T15:46:51.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17332025-06-04T15:46:51.747ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("74458287-879a-4471-829f-da352f40aff2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("84104d89-910f-45b9-adb6-d23a6d4f41d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("84104d89-910f-45b9-adb6-d23a6d4f41d6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1979, tv_nsec: 888379895 } })
17342025-06-04T15:46:51.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17352025-06-04T15:46:51.747ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d97642c-17fd-4803-bc28-7ad83219ce8c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("91bdae66-8e10-4892-9bfd-517dee32a9bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e10264ea-c7fb-4742-9452-fa5e125ebf3d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e10264ea-c7fb-4742-9452-fa5e125ebf3d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1979, tv_nsec: 888421086 } })
17362025-06-04T15:46:51.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17372025-06-04T15:46:51.747ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
17382025-06-04T15:46:51.747ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 944.192\u{b5}s iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
17392025-06-04T15:46:51.747ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
17402025-06-04T15:46:51.747ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.056803ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
17412025-06-04T15:46:51.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17422025-06-04T15:46:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17432025-06-04T15:46:51.748ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
17442025-06-04T15:46:51.748ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
17452025-06-04T15:46:51.748ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
17462025-06-04T15:46:51.748ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
17472025-06-04T15:46:51.748ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
17482025-06-04T15:46:51.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17492025-06-04T15:46:51.748ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17502025-06-04T15:46:51.748ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
17512025-06-04T15:46:51.748ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17522025-06-04T15:46:51.748ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
17532025-06-04T15:46:51.748ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17542025-06-04T15:46:51.748ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
17552025-06-04T15:46:51.748ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf
17562025-06-04T15:46:51.748ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
17572025-06-04T15:46:51.748ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Timeout
17582025-06-04T15:46:51.748ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.45\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf"}
17592025-06-04T15:46:51.748ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17602025-06-04T15:46:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17612025-06-04T15:46:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17622025-06-04T15:46:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17632025-06-04T15:46:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
17642025-06-04T15:46:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17652025-06-04T15:46:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17662025-06-04T15:46:51.749ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17672025-06-04T15:46:51.749ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
17682025-06-04T15:46:51.749ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17692025-06-04T15:46:51.749ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
17702025-06-04T15:46:51.749ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17712025-06-04T15:46:51.749ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
17722025-06-04T15:46:51.749ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
17732025-06-04T15:46:51.749ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17742025-06-04T15:46:51.749ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
17752025-06-04T15:46:51.749ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
17762025-06-04T15:46:51.749ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
17772025-06-04T15:46:51.749ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
17782025-06-04T15:46:51.749ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17792025-06-04T15:46:51.749ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
17802025-06-04T15:46:51.749ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17812025-06-04T15:46:51.749ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
17822025-06-04T15:46:51.749ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17832025-06-04T15:46:51.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17842025-06-04T15:46:51.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17852025-06-04T15:46:51.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17862025-06-04T15:46:51.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17872025-06-04T15:46:51.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17882025-06-04T15:46:51.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
17892025-06-04T15:46:51.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17902025-06-04T15:46:51.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17912025-06-04T15:46:51.750ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1979, tv_nsec: 891422163 } })
17922025-06-04T15:46:51.750ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
17932025-06-04T15:46:51.750ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-04 15:36:51.746753444 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
17942025-06-04T15:46:51.750ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.08101ms iteration = 12 status = {"expiration":"2025-06-04T15:36:51.746753444Z","pruned":[]}
17952025-06-04T15:46:51.751ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17962025-06-04T15:46:51.751ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1979, tv_nsec: 892889851 } })
17972025-06-04T15:46:51.751ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17982025-06-04T15:46:51.752ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
17992025-06-04T15:46:51.753ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
18002025-06-04T15:46:51.753ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18012025-06-04T15:46:51.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18022025-06-04T15:46:51.754ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.197576ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
18032025-06-04T15:46:51.755ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18042025-06-04T15:46:51.756ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18052025-06-04T15:46:51.757ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
18062025-06-04T15:46:51.757ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
18072025-06-04T15:46:51.757ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
18082025-06-04T15:46:51.757ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18092025-06-04T15:46:51.757ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
18102025-06-04T15:46:51.757ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
18112025-06-04T15:46:51.757ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
18122025-06-04T15:46:51.757ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
18132025-06-04T15:46:51.757ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
18142025-06-04T15:46:51.757ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
18152025-06-04T15:46:51.757ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
18162025-06-04T15:46:51.757ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18172025-06-04T15:46:51.757ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18182025-06-04T15:46:51.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
18192025-06-04T15:46:51.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
18202025-06-04T15:46:51.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
18212025-06-04T15:46:51.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
18222025-06-04T15:46:51.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18232025-06-04T15:46:51.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18242025-06-04T15:46:51.758ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18252025-06-04T15:46:51.759ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
18262025-06-04T15:46:51.759ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
18272025-06-04T15:46:51.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
18282025-06-04T15:46:51.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18292025-06-04T15:46:51.760ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18302025-06-04T15:46:51.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18312025-06-04T15:46:51.761ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 23 reason = Timeout
18322025-06-04T15:46:51.761ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
18332025-06-04T15:46:51.761ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 12 reason = Timeout
18342025-06-04T15:46:51.761ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
18352025-06-04T15:46:51.761ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 12 reason = Timeout
18362025-06-04T15:46:51.761ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
18372025-06-04T15:46:51.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
18382025-06-04T15:46:51.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
18392025-06-04T15:46:51.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
18402025-06-04T15:46:51.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18412025-06-04T15:46:51.764ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18422025-06-04T15:46:51.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18432025-06-04T15:46:51.767ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18442025-06-04T15:46:51.767ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18452025-06-04T15:46:51.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18462025-06-04T15:46:51.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
18472025-06-04T15:46:51.768ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18482025-06-04T15:46:51.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18492025-06-04T15:46:51.771ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18502025-06-04T15:46:51.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18512025-06-04T15:46:51.773ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.558163ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
18522025-06-04T15:46:51.776ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18532025-06-04T15:46:51.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18542025-06-04T15:46:51.776ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
18552025-06-04T15:46:51.776ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 15.008885ms iteration = 12 status = {"by_rx":{},"error":null}
18562025-06-04T15:46:51.791ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18572025-06-04T15:46:51.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
18582025-06-04T15:46:51.796ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18592025-06-04T15:46:51.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18602025-06-04T15:46:51.807ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18612025-06-04T15:46:51.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18622025-06-04T15:46:51.811ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18632025-06-04T15:46:51.814ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18642025-06-04T15:46:51.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18652025-06-04T15:46:51.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18662025-06-04T15:46:51.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18672025-06-04T15:46:51.815ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
18682025-06-04T15:46:51.815ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
18692025-06-04T15:46:51.815ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
18702025-06-04T15:46:51.816ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18712025-06-04T15:46:51.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18722025-06-04T15:46:51.817ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
18732025-06-04T15:46:51.817ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
18742025-06-04T15:46:51.817ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
18752025-06-04T15:46:51.817ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18762025-06-04T15:46:51.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18772025-06-04T15:46:51.817ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18782025-06-04T15:46:51.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
18792025-06-04T15:46:51.818ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
18802025-06-04T15:46:51.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
18812025-06-04T15:46:51.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18822025-06-04T15:46:51.820ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18832025-06-04T15:46:51.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18842025-06-04T15:46:51.822ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18852025-06-04T15:46:51.822ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
18862025-06-04T15:46:51.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18872025-06-04T15:46:51.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18882025-06-04T15:46:51.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18892025-06-04T15:46:51.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18902025-06-04T15:46:51.824ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
18912025-06-04T15:46:51.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18922025-06-04T15:46:51.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18932025-06-04T15:46:51.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
18942025-06-04T15:46:51.825ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 76.49028ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18952025-06-04T15:46:51.829ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18962025-06-04T15:46:51.829ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18972025-06-04T15:46:51.829ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
18982025-06-04T15:46:51.829ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18992025-06-04T15:46:51.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19002025-06-04T15:46:51.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19012025-06-04T15:46:51.832ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 83.432925ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19022025-06-04T15:46:51.832ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19032025-06-04T15:46:51.832ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19042025-06-04T15:46:51.833ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19052025-06-04T15:46:51.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19062025-06-04T15:46:51.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19072025-06-04T15:46:51.834ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 77.182069ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
19082025-06-04T15:46:51.835ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
19092025-06-04T15:46:51.836ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
19102025-06-04T15:46:51.836ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 78.667568ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
19112025-06-04T15:46:51.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19122025-06-04T15:46:51.836ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19132025-06-04T15:46:51.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19142025-06-04T15:46:51.837ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19152025-06-04T15:46:51.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19162025-06-04T15:46:51.837ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 80.246307ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
19172025-06-04T15:46:51.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19182025-06-04T15:46:51.837ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19192025-06-04T15:46:51.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19202025-06-04T15:46:51.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19212025-06-04T15:46:51.838ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 76.4164ms iteration = 23 status = {"errors":[],"requests_created_ok":[]}
19222025-06-04T15:46:51.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19232025-06-04T15:46:51.840ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 79.188123ms iteration = 12 status = {"dispatched":[],"errors":[],"glob_version":"147.0.0","globs_reprocessed":{},"no_receivers":[]}
19242025-06-04T15:46:51.841ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19252025-06-04T15:46:51.841ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19262025-06-04T15:46:51.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19272025-06-04T15:46:51.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19282025-06-04T15:46:51.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
19292025-06-04T15:46:51.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19302025-06-04T15:46:51.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19312025-06-04T15:46:51.849ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
19322025-06-04T15:46:51.849ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 4b1484ba-d395-4f36-93b6-c834b9680ee9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
19332025-06-04T15:46:51.849ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19342025-06-04T15:46:51.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19352025-06-04T15:46:51.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19362025-06-04T15:46:51.855ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
19372025-06-04T15:46:51.855ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
19382025-06-04T15:46:51.855ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 107.033816ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
19392025-06-04T15:46:51.855ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1979, tv_nsec: 996956320 } })
19402025-06-04T15:46:51.856ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
19412025-06-04T15:46:51.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19422025-06-04T15:46:51.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19432025-06-04T15:46:51.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19442025-06-04T15:46:51.863ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
19452025-06-04T15:46:51.863ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 115.222457ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
19462025-06-04T15:46:51.864ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19472025-06-04T15:46:51.864ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 114.796902ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19482025-06-04T15:46:51.870ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19492025-06-04T15:46:51.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
19502025-06-04T15:46:51.875ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19512025-06-04T15:46:51.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19522025-06-04T15:46:51.877ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19532025-06-04T15:46:51.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19542025-06-04T15:46:51.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19552025-06-04T15:46:51.887ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19562025-06-04T15:46:51.887ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19572025-06-04T15:46:51.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19582025-06-04T15:46:51.888ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
19592025-06-04T15:46:51.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
19602025-06-04T15:46:51.893ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 136.335716ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
19612025-06-04T15:46:51.897ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 140.631859ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19622025-06-04T15:46:51.898ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19632025-06-04T15:46:51.898ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19642025-06-04T15:46:51.898ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 148.87722ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
19652025-06-04T15:46:51.912ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
19662025-06-04T15:46:51.915ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
19672025-06-04T15:46:51.915ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19682025-06-04T15:46:51.916ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "252142a8-827e-4fbb-955b-bb1b2e9a816d", "content-length": "26", "date": "Wed, 04 Jun 2025 15:46:51 GMT"} })
19692025-06-04T15:46:51.916ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19702025-06-04T15:46:51.917ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19712025-06-04T15:46:51.926ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
19722025-06-04T15:46:51.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
19732025-06-04T15:46:51.936ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19742025-06-04T15:46:51.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19752025-06-04T15:46:51.964ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 215.750523ms iteration = 26 status = {"physical_disks_added":0}
19762025-06-04T15:46:52.032ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 zone_address = fd00:1122:3344:101::2
19772025-06-04T15:46:52.032ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19782025-06-04T15:46:52.032ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "57b9f883-5e27-4285-b9d6-ad7dc175e5ef", "content-length": "26", "date": "Wed, 04 Jun 2025 15:46:51 GMT"} })
19792025-06-04T15:46:52.032ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19802025-06-04T15:46:52.034ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
19812025-06-04T15:46:52.066ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
19822025-06-04T15:46:52.130ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
19832025-06-04T15:46:52.130ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19842025-06-04T15:46:52.130ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e655f575-98b1-4343-8d46-e1e2d2d46e12", "content-length": "26", "date": "Wed, 04 Jun 2025 15:46:51 GMT"} })
19852025-06-04T15:46:52.130ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19862025-06-04T15:46:52.131ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19872025-06-04T15:46:52.185ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
19882025-06-04T15:46:52.185ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19892025-06-04T15:46:52.185ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8dcb101-7cdd-47f3-9db1-c3771918abd5", "content-length": "372", "date": "Wed, 04 Jun 2025 15:46:52 GMT"} })
19902025-06-04T15:46:52.185ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19912025-06-04T15:46:52.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19922025-06-04T15:46:52.188ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 4b1484ba-d395-4f36-93b6-c834b9680ee9 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
19932025-06-04T15:46:52.188ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
19942025-06-04T15:46:52.188ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-04 15:35:53.349408 UTC dns_group = internal generation = 1
19952025-06-04T15:46:52.188ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 441.835122ms iteration = 12 status = {"generation":1}
19962025-06-04T15:46:52.188ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19972025-06-04T15:46:52.188ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19982025-06-04T15:46:52.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19992025-06-04T15:46:52.190ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20002025-06-04T15:46:52.191ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
20012025-06-04T15:46:52.191ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
20022025-06-04T15:46:52.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
20032025-06-04T15:46:52.193ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e751cd2d-7b1b-4ea0-8b5a-62525772a5f5, lookup_type: ById(e751cd2d-7b1b-4ea0-8b5a-62525772a5f5) } result = Ok(())
20042025-06-04T15:46:52.193ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20052025-06-04T15:46:52.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20062025-06-04T15:46:52.195ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 447.519543ms iteration = 23 status = 0
20072025-06-04T15:46:52.209ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
20082025-06-04T15:46:52.209ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "78cbc574-41f0-4c26-a621-ebeee2718782", "date": "Wed, 04 Jun 2025 15:46:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
20092025-06-04T15:46:52.209ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
20102025-06-04T15:46:52.211ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c72ce29b-830d-4f45-af38-b17727255741", "date": "Wed, 04 Jun 2025 15:46:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
20112025-06-04T15:46:52.211ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
20122025-06-04T15:46:52.212ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
20132025-06-04T15:46:52.212ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 466.00708ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
20142025-06-04T15:46:52.230ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20152025-06-04T15:46:52.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20162025-06-04T15:46:52.234ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
20172025-06-04T15:46:52.234ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3a2843d7-1e1c-47e4-9521-1eb938c0106b dns_zone_name = oxide.test found_so_far = 0 version = 2
20182025-06-04T15:46:52.234ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20192025-06-04T15:46:52.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20202025-06-04T15:46:52.236ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20212025-06-04T15:46:52.236ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20222025-06-04T15:46:52.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20232025-06-04T15:46:52.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20242025-06-04T15:46:52.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20252025-06-04T15:46:52.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20262025-06-04T15:46:52.240ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
20272025-06-04T15:46:52.240ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
20282025-06-04T15:46:52.240ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0743124f-8216-48ad-a169-3dd060320230", "date": "Wed, 04 Jun 2025 15:46:52 GMT"} })
20292025-06-04T15:46:52.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20302025-06-04T15:46:52.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20312025-06-04T15:46:52.241ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3a2843d7-1e1c-47e4-9521-1eb938c0106b dns_zone_name = oxide.test found_so_far = 4 version = 2
20322025-06-04T15:46:52.241ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
20332025-06-04T15:46:52.241ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-04 15:35:55.637968 UTC dns_group = external generation = 2
20342025-06-04T15:46:52.241ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 494.622082ms iteration = 12 status = {"generation":2}
20352025-06-04T15:46:52.241ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
20362025-06-04T15:46:52.241ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 493.271155ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
20372025-06-04T15:46:52.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20382025-06-04T15:46:52.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20392025-06-04T15:46:52.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20402025-06-04T15:46:52.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20412025-06-04T15:46:52.252ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
20422025-06-04T15:46:52.252ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20432025-06-04T15:46:52.253ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9896742f-cd69-46c5-91ef-3a8d9e4df99c", "date": "Wed, 04 Jun 2025 15:46:52 GMT"} })
20442025-06-04T15:46:52.254ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 505.442895ms iteration = 23 status = {}
20452025-06-04T15:46:52.263ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20462025-06-04T15:46:52.265ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
20472025-06-04T15:46:52.265ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20482025-06-04T15:46:52.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20492025-06-04T15:46:52.270ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20502025-06-04T15:46:52.273ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20512025-06-04T15:46:52.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20522025-06-04T15:46:52.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20532025-06-04T15:46:52.279ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20542025-06-04T15:46:52.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20552025-06-04T15:46:52.281ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 534.400701ms iteration = 23 status = null
20562025-06-04T15:46:52.289ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 543.259389ms iteration = 23 status = {}
20572025-06-04T15:46:52.298ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
20582025-06-04T15:46:52.298ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 549.474816ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
20592025-06-04T15:46:52.300ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
20602025-06-04T15:46:52.301ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-04T15:35:43.043689Z, time_modified: 2025-06-04T15:35:43.043689Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: bcca9629-d8e0-4351-a4fb-8029b18eb633, db_silo: Silo { identity: SiloIdentity { id: bcca9629-d8e0-4351-a4fb-8029b18eb633, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-04T15:35:55.573183Z, time_modified: 2025-06-04T15:35:55.573183Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a49af7a2313337b84535ddab02a38b7781b3f7789d0df44311ad2658fa92170d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: bcca9629-d8e0-4351-a4fb-8029b18eb633, db_silo: Silo { identity: SiloIdentity { id: bcca9629-d8e0-4351-a4fb-8029b18eb633, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-04T15:35:55.573183Z, time_modified: 2025-06-04T15:35:55.573183Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a49af7a2313337b84535ddab02a38b7781b3f7789d0df44311ad2658fa92170d" }] }) }
20612025-06-04T15:46:52.301ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 554.799441ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"bcca9629-d8e0-4351-a4fb-8029b18eb633","tls_certs":["a49af7a2313337b84535ddab02a38b7781b3f7789d0df44311ad2658fa92170d"]}},"default_endpoint":{"silo_id":"bcca9629-d8e0-4351-a4fb-8029b18eb633","tls_certs":["a49af7a2313337b84535ddab02a38b7781b3f7789d0df44311ad2658fa92170d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
20622025-06-04T15:46:52.316ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20632025-06-04T15:46:52.318ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20642025-06-04T15:46:52.318ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20652025-06-04T15:46:52.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20662025-06-04T15:46:52.401ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20672025-06-04T15:46:52.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20682025-06-04T15:46:52.403ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 8dbb977a-0cb9-4cf4-916b-4e19edd41b70, rack_id: 2302d566-cff7-41c0-b6e9-4f6ac6057661, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(aeecc71f-0b8d-4aaf-8e0e-04ee00063f7a) } rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0
20692025-06-04T15:46:52.403ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20702025-06-04T15:46:52.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20712025-06-04T15:46:52.416ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
20722025-06-04T15:46:52.416ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = aeecc71f-0b8d-4aaf-8e0e-04ee00063f7a
20732025-06-04T15:46:52.417ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
20742025-06-04T15:46:52.417ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20752025-06-04T15:46:52.417ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20762025-06-04T15:46:52.417ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20772025-06-04T15:46:52.417ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20782025-06-04T15:46:52.417ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20792025-06-04T15:46:52.417ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20802025-06-04T15:46:52.417ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20812025-06-04T15:46:52.417ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
20822025-06-04T15:46:52.417ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20832025-06-04T15:46:52.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20842025-06-04T15:46:52.420ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0
20852025-06-04T15:46:52.420ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
20862025-06-04T15:46:52.429ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
20872025-06-04T15:46:52.430ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ecdbd168-7b11-4960-b91b-5d9588dcb5f2", "date": "Wed, 04 Jun 2025 15:46:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
20882025-06-04T15:46:52.430ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
20892025-06-04T15:46:52.431ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "09abf097-94c0-47a3-b0d0-3542252c0c2b", "date": "Wed, 04 Jun 2025 15:46:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
20902025-06-04T15:46:52.431ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
20912025-06-04T15:46:52.433ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "29c0e198-1cd8-44c7-b12b-0031c887c07e", "date": "Wed, 04 Jun 2025 15:46:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
20922025-06-04T15:46:52.433ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
20932025-06-04T15:46:52.434ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
20942025-06-04T15:46:52.434ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 687.851807ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
20952025-06-04T15:46:52.442ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20962025-06-04T15:46:52.534ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3fbacc6f-de1c-406d-a951-a0c8fef57528", "date": "Wed, 04 Jun 2025 15:46:52 GMT"} })
20972025-06-04T15:46:52.534ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch = Switch0
20982025-06-04T15:46:52.534ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
20992025-06-04T15:46:52.534ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea2d2ac5-ba68-493e-a925-7ad55fd19c99", "content-length": "691", "date": "Wed, 04 Jun 2025 15:46:52 GMT"} })
21002025-06-04T15:46:52.534ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
21012025-06-04T15:46:52.534ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
21022025-06-04T15:46:52.534ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
21032025-06-04T15:46:52.534ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6520171f-6f86-4503-8816-ca70e8273f84", "content-length": "682", "date": "Wed, 04 Jun 2025 15:46:51 GMT"} })
21042025-06-04T15:46:52.534ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21052025-06-04T15:46:52.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21062025-06-04T15:46:52.536ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 787.425982ms iteration = 23 status = {}
21072025-06-04T15:46:52.538ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21082025-06-04T15:46:52.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21092025-06-04T15:46:52.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21102025-06-04T15:46:52.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21112025-06-04T15:46:52.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21122025-06-04T15:46:52.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21132025-06-04T15:46:52.550ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 802.167672ms iteration = 23 status = {}
21142025-06-04T15:46:52.619ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 4
21152025-06-04T15:46:52.619ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221
21162025-06-04T15:46:52.650ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
21172025-06-04T15:46:52.650ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:60209
21182025-06-04T15:46:52.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7ec48c7a-077d-4fe7-bd1e-04be3ea6a200 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21192025-06-04T15:46:52.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:60209 req_id = fb1bad82-18e1-4387-9bab-46e4bc4fba7a roles = RoleSet { roles: {} } uri = /metrics/producers
21202025-06-04T15:46:52.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7ec48c7a-077d-4fe7-bd1e-04be3ea6a200 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21212025-06-04T15:46:52.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:60209 req_id = fb1bad82-18e1-4387-9bab-46e4bc4fba7a resource = Database result = Ok(()) uri = /metrics/producers
21222025-06-04T15:46:52.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7ec48c7a-077d-4fe7-bd1e-04be3ea6a200 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21232025-06-04T15:46:52.689ZINFOnexus: assigned collector to new producer collector_id = 93dd7779-b561-4a6e-a81b-f44350333434 file = nexus/src/app/oximeter.rs:76 producer_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
21242025-06-04T15:46:52.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 39265 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:60209 req_id = fb1bad82-18e1-4387-9bab-46e4bc4fba7a response_code = 201 uri = /metrics/producers
21252025-06-04T15:46:52.689ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "fb1bad82-18e1-4387-9bab-46e4bc4fba7a", "content-length": "41", "date": "Wed, 04 Jun 2025 15:46:52 GMT"} })
21262025-06-04T15:46:52.691ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
21272025-06-04T15:46:53.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b5ca4ecc-4d2f-4f94-a0d8-4560f8e287cb roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21282025-06-04T15:46:53.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b5ca4ecc-4d2f-4f94-a0d8-4560f8e287cb resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21292025-06-04T15:46:53.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b5ca4ecc-4d2f-4f94-a0d8-4560f8e287cb response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21302025-06-04T15:46:54.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 617a148a-0580-47ed-8c6a-01b32183aae5 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21312025-06-04T15:46:54.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 617a148a-0580-47ed-8c6a-01b32183aae5 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21322025-06-04T15:46:54.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2896 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 617a148a-0580-47ed-8c6a-01b32183aae5 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21332025-06-04T15:46:55.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a2b452be-075e-4aed-9e90-dd2476b0c929 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21342025-06-04T15:46:55.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a2b452be-075e-4aed-9e90-dd2476b0c929 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21352025-06-04T15:46:55.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a2b452be-075e-4aed-9e90-dd2476b0c929 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21362025-06-04T15:46:56.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3d223c6d-f7e7-4d4e-9d1e-b6db3c07a695 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21372025-06-04T15:46:56.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3d223c6d-f7e7-4d4e-9d1e-b6db3c07a695 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21382025-06-04T15:46:56.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3d223c6d-f7e7-4d4e-9d1e-b6db3c07a695 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21392025-06-04T15:46:57.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = fb320bdd-4cef-4704-b77b-bd852638fed9 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21402025-06-04T15:46:57.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = fb320bdd-4cef-4704-b77b-bd852638fed9 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21412025-06-04T15:46:57.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2499 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = fb320bdd-4cef-4704-b77b-bd852638fed9 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21422025-06-04T15:46:58.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 19ec2448-c596-45ae-b88a-0f6a2a6892c3 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21432025-06-04T15:46:58.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 19ec2448-c596-45ae-b88a-0f6a2a6892c3 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21442025-06-04T15:46:58.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 19ec2448-c596-45ae-b88a-0f6a2a6892c3 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21452025-06-04T15:46:59.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8e1ad489-e91f-4047-bd81-6adb8cba675e roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21462025-06-04T15:46:59.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8e1ad489-e91f-4047-bd81-6adb8cba675e resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21472025-06-04T15:46:59.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2572 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8e1ad489-e91f-4047-bd81-6adb8cba675e response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21482025-06-04T15:46:59.950ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 463 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = 0978a843-faf9-4a2c-ba89-03cff26c0824 response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
21492025-06-04T15:47:00.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = dfdc00ad-72b0-4079-b2ef-bcb248330954 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21502025-06-04T15:47:00.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = dfdc00ad-72b0-4079-b2ef-bcb248330954 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21512025-06-04T15:47:00.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = dfdc00ad-72b0-4079-b2ef-bcb248330954 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21522025-06-04T15:47:01.748ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
21532025-06-04T15:47:01.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21542025-06-04T15:47:01.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21552025-06-04T15:47:01.749ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
21562025-06-04T15:47:01.749ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21572025-06-04T15:47:01.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21582025-06-04T15:47:01.785ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21592025-06-04T15:47:01.785ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21602025-06-04T15:47:01.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21612025-06-04T15:47:01.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21622025-06-04T15:47:01.788ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21632025-06-04T15:47:01.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21642025-06-04T15:47:01.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21652025-06-04T15:47:01.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21662025-06-04T15:47:01.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21672025-06-04T15:47:01.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
21682025-06-04T15:47:01.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21692025-06-04T15:47:01.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21702025-06-04T15:47:01.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a922fbe6-05f8-4140-91bf-78f7ec2e609c roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21712025-06-04T15:47:01.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a922fbe6-05f8-4140-91bf-78f7ec2e609c resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21722025-06-04T15:47:01.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a922fbe6-05f8-4140-91bf-78f7ec2e609c response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21732025-06-04T15:47:01.805ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
21742025-06-04T15:47:01.805ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 57.154773ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
21752025-06-04T15:47:01.820ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.063163ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21762025-06-04T15:47:02.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = c300715f-9ab5-4f0c-b172-8c5f3c365d08 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21772025-06-04T15:47:02.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = c300715f-9ab5-4f0c-b172-8c5f3c365d08 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21782025-06-04T15:47:02.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = c300715f-9ab5-4f0c-b172-8c5f3c365d08 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21792025-06-04T15:47:03.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 46dd5d7c-57fd-4d64-a5b2-caff2a214de2 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21802025-06-04T15:47:03.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 46dd5d7c-57fd-4d64-a5b2-caff2a214de2 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21812025-06-04T15:47:03.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2511 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 46dd5d7c-57fd-4d64-a5b2-caff2a214de2 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21822025-06-04T15:47:04.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 747b7340-7510-4e78-81d6-dff2b906bbf6 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21832025-06-04T15:47:04.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 747b7340-7510-4e78-81d6-dff2b906bbf6 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21842025-06-04T15:47:04.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 747b7340-7510-4e78-81d6-dff2b906bbf6 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21852025-06-04T15:47:05.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 054bcb16-316d-45d8-a06c-a582fc07ab7f roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21862025-06-04T15:47:05.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 054bcb16-316d-45d8-a06c-a582fc07ab7f resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21872025-06-04T15:47:05.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 054bcb16-316d-45d8-a06c-a582fc07ab7f response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21882025-06-04T15:47:06.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 350f263b-8e55-4c09-888a-b8d07c175a20 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21892025-06-04T15:47:06.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 350f263b-8e55-4c09-888a-b8d07c175a20 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21902025-06-04T15:47:06.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1893 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 350f263b-8e55-4c09-888a-b8d07c175a20 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21912025-06-04T15:47:07.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2b05f8ae-4126-45d0-8c4f-665bbc060817 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21922025-06-04T15:47:07.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2b05f8ae-4126-45d0-8c4f-665bbc060817 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21932025-06-04T15:47:07.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2b05f8ae-4126-45d0-8c4f-665bbc060817 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21942025-06-04T15:47:08.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 520d3ca1-94b8-4949-b8bf-d80debf7f352 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21952025-06-04T15:47:08.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 520d3ca1-94b8-4949-b8bf-d80debf7f352 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21962025-06-04T15:47:08.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 520d3ca1-94b8-4949-b8bf-d80debf7f352 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21972025-06-04T15:47:09.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8cfa5bf0-261b-41d2-a932-7b9700b5aa03 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21982025-06-04T15:47:09.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8cfa5bf0-261b-41d2-a932-7b9700b5aa03 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
21992025-06-04T15:47:09.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8cfa5bf0-261b-41d2-a932-7b9700b5aa03 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22002025-06-04T15:47:09.950ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 457 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = d2f1a192-e0d4-4f85-87a0-3aa96a44e25a response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
22012025-06-04T15:47:10.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4c6c0790-cd78-4dea-9350-3bcb4f909a40 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22022025-06-04T15:47:10.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4c6c0790-cd78-4dea-9350-3bcb4f909a40 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22032025-06-04T15:47:10.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2416 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4c6c0790-cd78-4dea-9350-3bcb4f909a40 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22042025-06-04T15:47:11.748ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
22052025-06-04T15:47:11.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22062025-06-04T15:47:11.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22072025-06-04T15:47:11.750ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
22082025-06-04T15:47:11.750ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22092025-06-04T15:47:11.750ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22102025-06-04T15:47:11.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22112025-06-04T15:47:11.751ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22122025-06-04T15:47:11.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22132025-06-04T15:47:11.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22142025-06-04T15:47:11.753ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22152025-06-04T15:47:11.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22162025-06-04T15:47:11.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22172025-06-04T15:47:11.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22182025-06-04T15:47:11.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22192025-06-04T15:47:11.759ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
22202025-06-04T15:47:11.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22212025-06-04T15:47:11.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22222025-06-04T15:47:11.771ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
22232025-06-04T15:47:11.771ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.639789ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
22242025-06-04T15:47:11.796ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 46.184248ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22252025-06-04T15:47:11.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ff01e130-b7ce-4d5b-955f-d32feb6e2bc4 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22262025-06-04T15:47:11.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ff01e130-b7ce-4d5b-955f-d32feb6e2bc4 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22272025-06-04T15:47:11.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2002 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ff01e130-b7ce-4d5b-955f-d32feb6e2bc4 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22282025-06-04T15:47:12.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d0fa73e7-eb5f-4f81-9c06-b26e2da533bd roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22292025-06-04T15:47:12.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d0fa73e7-eb5f-4f81-9c06-b26e2da533bd resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22302025-06-04T15:47:12.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d0fa73e7-eb5f-4f81-9c06-b26e2da533bd response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22312025-06-04T15:47:13.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6f1c90bb-c976-44e9-9ef3-53626ef97108 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22322025-06-04T15:47:13.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6f1c90bb-c976-44e9-9ef3-53626ef97108 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22332025-06-04T15:47:13.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6f1c90bb-c976-44e9-9ef3-53626ef97108 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22342025-06-04T15:47:15.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9346e165-5542-4bed-82a6-e1b5f3328c64 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22352025-06-04T15:47:15.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9346e165-5542-4bed-82a6-e1b5f3328c64 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22362025-06-04T15:47:15.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2050 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9346e165-5542-4bed-82a6-e1b5f3328c64 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22372025-06-04T15:47:16.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = cc95e5f9-b648-4a57-a03a-9175a7b68d46 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22382025-06-04T15:47:16.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = cc95e5f9-b648-4a57-a03a-9175a7b68d46 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22392025-06-04T15:47:16.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = cc95e5f9-b648-4a57-a03a-9175a7b68d46 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22402025-06-04T15:47:17.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 70ba6584-3828-4651-82f8-2d6f63066a28 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22412025-06-04T15:47:17.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 70ba6584-3828-4651-82f8-2d6f63066a28 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22422025-06-04T15:47:17.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 70ba6584-3828-4651-82f8-2d6f63066a28 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22432025-06-04T15:47:18.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 13160c90-d34b-4d34-a49c-69650196357a roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22442025-06-04T15:47:18.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 13160c90-d34b-4d34-a49c-69650196357a resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22452025-06-04T15:47:18.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 13160c90-d34b-4d34-a49c-69650196357a response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22462025-06-04T15:47:19.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7e7fb8d6-5ab6-486e-ad2c-97daeb43f864 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22472025-06-04T15:47:19.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7e7fb8d6-5ab6-486e-ad2c-97daeb43f864 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22482025-06-04T15:47:19.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2730 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7e7fb8d6-5ab6-486e-ad2c-97daeb43f864 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22492025-06-04T15:47:19.950ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 495 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = c3937c21-5d73-41b2-9704-bf262923aeab response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
22502025-06-04T15:47:20.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6c818217-6c53-4ce7-b5e5-726ff2359011 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22512025-06-04T15:47:20.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6c818217-6c53-4ce7-b5e5-726ff2359011 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22522025-06-04T15:47:20.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2457 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6c818217-6c53-4ce7-b5e5-726ff2359011 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22532025-06-04T15:47:21.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = dd0fcc89-1727-4770-ae7c-d9fa9e30431a roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22542025-06-04T15:47:21.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = dd0fcc89-1727-4770-ae7c-d9fa9e30431a resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22552025-06-04T15:47:21.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1663 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = dd0fcc89-1727-4770-ae7c-d9fa9e30431a response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
22562025-06-04T15:47:21.747ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
22572025-06-04T15:47:21.747ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
22582025-06-04T15:47:21.747ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
22592025-06-04T15:47:21.747ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22602025-06-04T15:47:21.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
22612025-06-04T15:47:21.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22622025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
22632025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
22642025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
22652025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22662025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22672025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
22682025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
22692025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
22702025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22712025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
22722025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22732025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
22742025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22752025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
22762025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22772025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22782025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
22792025-06-04T15:47:21.749ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
22802025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
22812025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22822025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
22832025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22842025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22852025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
22862025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22872025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22882025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22892025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22902025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
22912025-06-04T15:47:21.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22922025-06-04T15:47:21.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22932025-06-04T15:47:21.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22942025-06-04T15:47:21.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22952025-06-04T15:47:21.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22962025-06-04T15:47:21.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22972025-06-04T15:47:21.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22982025-06-04T15:47:21.750ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2009, tv_nsec: 891288581 } })
22992025-06-04T15:47:21.750ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2009, tv_nsec: 891297051 } })
23002025-06-04T15:47:21.750ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
23012025-06-04T15:47:21.751ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
23022025-06-04T15:47:21.751ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23032025-06-04T15:47:21.752ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23042025-06-04T15:47:21.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23052025-06-04T15:47:21.753ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23062025-06-04T15:47:21.753ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.425165ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
23072025-06-04T15:47:21.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
23082025-06-04T15:47:21.756ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23092025-06-04T15:47:21.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
23102025-06-04T15:47:21.756ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23112025-06-04T15:47:21.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23122025-06-04T15:47:21.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23132025-06-04T15:47:21.757ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
23142025-06-04T15:47:21.757ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
23152025-06-04T15:47:21.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
23162025-06-04T15:47:21.757ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23172025-06-04T15:47:21.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23182025-06-04T15:47:21.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23192025-06-04T15:47:21.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
23202025-06-04T15:47:21.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
23212025-06-04T15:47:21.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23222025-06-04T15:47:21.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
23232025-06-04T15:47:21.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
23242025-06-04T15:47:21.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
23252025-06-04T15:47:21.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
23262025-06-04T15:47:21.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23272025-06-04T15:47:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
23282025-06-04T15:47:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
23292025-06-04T15:47:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23302025-06-04T15:47:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23312025-06-04T15:47:21.759ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23322025-06-04T15:47:21.760ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23332025-06-04T15:47:21.761ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23342025-06-04T15:47:21.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23352025-06-04T15:47:21.762ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 24 reason = Timeout
23362025-06-04T15:47:21.762ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
23372025-06-04T15:47:21.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
23382025-06-04T15:47:21.762ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2009, tv_nsec: 903014745 } })
23392025-06-04T15:47:21.762ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
23402025-06-04T15:47:21.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
23412025-06-04T15:47:21.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23422025-06-04T15:47:21.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23432025-06-04T15:47:21.762ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23442025-06-04T15:47:21.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23452025-06-04T15:47:21.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23462025-06-04T15:47:21.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23472025-06-04T15:47:21.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23482025-06-04T15:47:21.779ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23492025-06-04T15:47:21.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23502025-06-04T15:47:21.793ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23512025-06-04T15:47:21.797ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23522025-06-04T15:47:21.797ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23532025-06-04T15:47:21.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23542025-06-04T15:47:21.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 44.429116ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
23552025-06-04T15:47:21.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23562025-06-04T15:47:21.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23572025-06-04T15:47:21.811ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23582025-06-04T15:47:21.811ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
23592025-06-04T15:47:21.811ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23602025-06-04T15:47:21.811ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23612025-06-04T15:47:21.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23622025-06-04T15:47:21.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23632025-06-04T15:47:21.816ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23642025-06-04T15:47:21.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23652025-06-04T15:47:21.817ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23662025-06-04T15:47:21.817ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23672025-06-04T15:47:21.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23682025-06-04T15:47:21.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23692025-06-04T15:47:21.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23702025-06-04T15:47:21.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23712025-06-04T15:47:21.819ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 69.887189ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23722025-06-04T15:47:21.819ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.172033ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23732025-06-04T15:47:21.820ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 62.65364ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23742025-06-04T15:47:21.821ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.221697ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
23752025-06-04T15:47:21.825ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
23762025-06-04T15:47:21.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
23772025-06-04T15:47:21.827ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23782025-06-04T15:47:21.828ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 66.382256ms iteration = 24 status = {"errors":[],"requests_created_ok":[]}
23792025-06-04T15:47:21.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23802025-06-04T15:47:21.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
23812025-06-04T15:47:21.829ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
23822025-06-04T15:47:21.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
23832025-06-04T15:47:21.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
23842025-06-04T15:47:21.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23852025-06-04T15:47:21.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23862025-06-04T15:47:21.834ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
23872025-06-04T15:47:21.834ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 84.950134ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
23882025-06-04T15:47:21.836ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23892025-06-04T15:47:21.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23902025-06-04T15:47:21.838ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23912025-06-04T15:47:21.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23922025-06-04T15:47:21.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23932025-06-04T15:47:21.841ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
23942025-06-04T15:47:21.841ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 92.413996ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
23952025-06-04T15:47:21.842ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23962025-06-04T15:47:21.842ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23972025-06-04T15:47:21.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23982025-06-04T15:47:21.853ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
23992025-06-04T15:47:21.853ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24002025-06-04T15:47:21.854ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "634d34b3-4d8a-46c3-b3a8-5ad2e24c333e", "content-length": "26", "date": "Wed, 04 Jun 2025 15:47:21 GMT"} })
24012025-06-04T15:47:21.854ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24022025-06-04T15:47:21.855ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24032025-06-04T15:47:21.855ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
24042025-06-04T15:47:21.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24052025-06-04T15:47:21.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24062025-06-04T15:47:21.855ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24072025-06-04T15:47:21.860ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24082025-06-04T15:47:21.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e751cd2d-7b1b-4ea0-8b5a-62525772a5f5, lookup_type: ById(e751cd2d-7b1b-4ea0-8b5a-62525772a5f5) } result = Ok(())
24092025-06-04T15:47:21.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24102025-06-04T15:47:21.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24112025-06-04T15:47:21.868ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 119.5373ms iteration = 24 status = 0
24122025-06-04T15:47:21.872ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24132025-06-04T15:47:21.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24142025-06-04T15:47:21.897ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24152025-06-04T15:47:21.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24162025-06-04T15:47:21.902ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24172025-06-04T15:47:21.902ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24182025-06-04T15:47:21.902ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 153.221484ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
24192025-06-04T15:47:21.909ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 151.539083ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
24202025-06-04T15:47:21.942ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/819ba797-f51f-4633-b363-42925ec3968b/state
24212025-06-04T15:47:21.956ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 207.282328ms iteration = 27 status = {"physical_disks_added":0}
24222025-06-04T15:47:21.967ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
24232025-06-04T15:47:21.967ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24242025-06-04T15:47:21.967ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a9a1100-9419-4c11-ae9c-9bab3b250426", "content-length": "26", "date": "Wed, 04 Jun 2025 15:47:21 GMT"} })
24252025-06-04T15:47:21.967ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24262025-06-04T15:47:21.968ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 zone_address = fd00:1122:3344:101::2
24272025-06-04T15:47:21.968ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24282025-06-04T15:47:21.968ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4668625a-b7ff-4ca4-8e4b-96a80b323be0", "content-length": "26", "date": "Wed, 04 Jun 2025 15:47:21 GMT"} })
24292025-06-04T15:47:21.968ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24302025-06-04T15:47:21.968ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24312025-06-04T15:47:21.969ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24322025-06-04T15:47:21.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24332025-06-04T15:47:21.970ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
24342025-06-04T15:47:21.971ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 223.810151ms iteration = 24 status = null
24352025-06-04T15:47:21.997ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24362025-06-04T15:47:21.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24372025-06-04T15:47:21.999ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24382025-06-04T15:47:22.001ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24392025-06-04T15:47:22.001ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24402025-06-04T15:47:22.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24412025-06-04T15:47:22.012ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
24422025-06-04T15:47:22.012ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24432025-06-04T15:47:22.012ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "58184709-e2c3-4fb7-a984-b63f6bfc24d7", "content-length": "583", "date": "Wed, 04 Jun 2025 15:47:21 GMT"} })
24442025-06-04T15:47:22.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24452025-06-04T15:47:22.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24462025-06-04T15:47:22.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24472025-06-04T15:47:22.015ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24482025-06-04T15:47:22.015ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24492025-06-04T15:47:22.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24502025-06-04T15:47:22.030ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {497fe7a5-2783-4543-b9c5-2a39d325a3d6: {10.151.1.175: {e1c72213-bcb2-487e-848f-b37d655682bc}, 10.151.1.176: {e1c72213-bcb2-487e-848f-b37d655682bc}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
24512025-06-04T15:47:22.030ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
24522025-06-04T15:47:22.030ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f9c91e33-0abb-4957-bca9-a0df50494d49", "date": "Wed, 04 Jun 2025 15:47:21 GMT"} })
24532025-06-04T15:47:22.030ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24542025-06-04T15:47:22.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24552025-06-04T15:47:22.033ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24562025-06-04T15:47:22.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24572025-06-04T15:47:22.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24582025-06-04T15:47:22.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24592025-06-04T15:47:22.038ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24602025-06-04T15:47:22.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24612025-06-04T15:47:22.041ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24622025-06-04T15:47:22.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24632025-06-04T15:47:22.050ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 303.109987ms iteration = 24 status = {}
24642025-06-04T15:47:22.071ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24652025-06-04T15:47:22.071ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "42724cfa-3b55-4892-aa79-d9656bab3422", "content-length": "810", "date": "Wed, 04 Jun 2025 15:47:21 GMT"} })
24662025-06-04T15:47:22.071ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(6326005) }} sled = buskin
24672025-06-04T15:47:22.071ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
24682025-06-04T15:47:22.071ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
24692025-06-04T15:47:22.073ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 324.339718ms iteration = 24 status = {}
24702025-06-04T15:47:22.074ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24712025-06-04T15:47:22.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24722025-06-04T15:47:22.077ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
24732025-06-04T15:47:22.077ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
24742025-06-04T15:47:22.077ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24752025-06-04T15:47:22.078ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "630f58bc-606e-4afe-9e71-76de001171ea", "date": "Wed, 04 Jun 2025 15:47:21 GMT"} })
24762025-06-04T15:47:22.079ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 329.985737ms iteration = 24 status = {}
24772025-06-04T15:47:22.111ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24782025-06-04T15:47:22.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24792025-06-04T15:47:22.113ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 8dbb977a-0cb9-4cf4-916b-4e19edd41b70, rack_id: 2302d566-cff7-41c0-b6e9-4f6ac6057661, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(aeecc71f-0b8d-4aaf-8e0e-04ee00063f7a) } rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0
24802025-06-04T15:47:22.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24812025-06-04T15:47:22.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24822025-06-04T15:47:22.125ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
24832025-06-04T15:47:22.125ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = aeecc71f-0b8d-4aaf-8e0e-04ee00063f7a
24842025-06-04T15:47:22.125ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
24852025-06-04T15:47:22.125ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24862025-06-04T15:47:22.125ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24872025-06-04T15:47:22.125ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24882025-06-04T15:47:22.125ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24892025-06-04T15:47:22.125ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24902025-06-04T15:47:22.125ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24912025-06-04T15:47:22.125ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24922025-06-04T15:47:22.126ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
24932025-06-04T15:47:22.126ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24942025-06-04T15:47:22.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24952025-06-04T15:47:22.128ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0
24962025-06-04T15:47:22.128ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24972025-06-04T15:47:22.231ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "dc62e3b5-1b53-4664-b167-091c66bc0fc9", "date": "Wed, 04 Jun 2025 15:47:21 GMT"} })
24982025-06-04T15:47:22.231ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch = Switch0
24992025-06-04T15:47:22.231ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
25002025-06-04T15:47:22.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3bc7dbcc-47bb-4092-85bd-76249302626e roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25012025-06-04T15:47:22.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3bc7dbcc-47bb-4092-85bd-76249302626e resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25022025-06-04T15:47:22.231ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0482910-a992-43fe-b9bb-ebce9f0eef39", "content-length": "682", "date": "Wed, 04 Jun 2025 15:47:21 GMT"} })
25032025-06-04T15:47:22.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25042025-06-04T15:47:22.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25052025-06-04T15:47:22.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1889 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3bc7dbcc-47bb-4092-85bd-76249302626e response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25062025-06-04T15:47:22.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25072025-06-04T15:47:22.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25082025-06-04T15:47:22.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25092025-06-04T15:47:22.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25102025-06-04T15:47:22.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25112025-06-04T15:47:22.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25122025-06-04T15:47:22.249ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 500.20065ms iteration = 24 status = {}
25132025-06-04T15:47:23.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a6a10aad-83d1-4d9a-87c1-11197d56578a roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25142025-06-04T15:47:23.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a6a10aad-83d1-4d9a-87c1-11197d56578a resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25152025-06-04T15:47:23.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a6a10aad-83d1-4d9a-87c1-11197d56578a response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25162025-06-04T15:47:23.607ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/819ba797-f51f-4633-b363-42925ec3968b/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e3cf748-4ff4-41e1-96bb-b19395afbff6", "content-length": "131", "date": "Wed, 04 Jun 2025 15:47:23 GMT"} })
25172025-06-04T15:47:23.610ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 sled_id = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-06-04T15:47:15.726998786Z }, migration_in: None, migration_out: None } vmm_id = 819ba797-f51f-4633-b363-42925ec3968b
25182025-06-04T15:47:23.610ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2140 instance_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 819ba797-f51f-4633-b363-42925ec3968b sled_id = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 vmm_id = 819ba797-f51f-4633-b363-42925ec3968b vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-06-04T15:47:15.726998786Z }
25192025-06-04T15:47:23.610ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 roles = RoleSet { roles: {} } sled_id = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 vmm_id = 819ba797-f51f-4633-b363-42925ec3968b
25202025-06-04T15:47:23.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 resource = Database result = Ok(()) sled_id = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 vmm_id = 819ba797-f51f-4633-b363-42925ec3968b
25212025-06-04T15:47:23.652ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
25222025-06-04T15:47:23.654ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 1.905354536s iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
25232025-06-04T15:47:23.777ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 819ba797-f51f-4633-b363-42925ec3968b remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0eac3974-491f-4b65-b12a-126ffb640ef7 uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2025-06-04T15:47:23.758982937Z }
25242025-06-04T15:47:23.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0eac3974-491f-4b65-b12a-126ffb640ef7 roles = RoleSet { roles: {} } uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b
25252025-06-04T15:47:23.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0eac3974-491f-4b65-b12a-126ffb640ef7 resource = Database result = Ok(()) uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b
25262025-06-04T15:47:23.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 27743 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0eac3974-491f-4b65-b12a-126ffb640ef7 response_code = 204 uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b
25272025-06-04T15:47:24.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bf56ac83-0851-4ed5-8f53-47f9ce04dcc2 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25282025-06-04T15:47:24.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bf56ac83-0851-4ed5-8f53-47f9ce04dcc2 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25292025-06-04T15:47:24.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2246 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bf56ac83-0851-4ed5-8f53-47f9ce04dcc2 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25302025-06-04T15:47:25.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f6636e68-9d21-4480-99cb-401cf380ba37 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25312025-06-04T15:47:25.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f6636e68-9d21-4480-99cb-401cf380ba37 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25322025-06-04T15:47:25.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2765 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f6636e68-9d21-4480-99cb-401cf380ba37 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25332025-06-04T15:47:26.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 15849f39-7a61-4a1f-b09d-421a9af04972 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25342025-06-04T15:47:26.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 15849f39-7a61-4a1f-b09d-421a9af04972 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25352025-06-04T15:47:26.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 4723 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 15849f39-7a61-4a1f-b09d-421a9af04972 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25362025-06-04T15:47:27.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 09e88680-656d-4d84-af5e-dc3d2a457bee roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25372025-06-04T15:47:27.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 09e88680-656d-4d84-af5e-dc3d2a457bee resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25382025-06-04T15:47:27.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2537 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 09e88680-656d-4d84-af5e-dc3d2a457bee response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25392025-06-04T15:47:28.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8795b692-0e87-484b-9576-cfac9dbcdb3e roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25402025-06-04T15:47:28.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8795b692-0e87-484b-9576-cfac9dbcdb3e resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25412025-06-04T15:47:28.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8795b692-0e87-484b-9576-cfac9dbcdb3e response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25422025-06-04T15:47:29.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0bd75129-f194-4802-b581-1d7fd7f4a07a roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25432025-06-04T15:47:29.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0bd75129-f194-4802-b581-1d7fd7f4a07a resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25442025-06-04T15:47:29.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2651 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0bd75129-f194-4802-b581-1d7fd7f4a07a response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25452025-06-04T15:47:29.941ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:33622
25462025-06-04T15:47:29.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33622 req_id = f49a119e-d2f1-48dd-abd6-0aa879552489 roles = RoleSet { roles: {} } uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?sort_by=id_ascending
25472025-06-04T15:47:29.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33622 req_id = f49a119e-d2f1-48dd-abd6-0aa879552489 resource = Database result = Ok(()) uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?sort_by=id_ascending
25482025-06-04T15:47:29.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3587 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33622 req_id = f49a119e-d2f1-48dd-abd6-0aa879552489 response_code = 200 uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?sort_by=id_ascending
25492025-06-04T15:47:29.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33622 req_id = 5c59614d-c41e-4487-a006-acb1a5f89226 roles = RoleSet { roles: {} } uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzUxY2QyZC03YjFiLTRlYTAtOGI1YS02MjUyNTc3MmE1ZjUifX0%3D
25502025-06-04T15:47:29.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33622 req_id = 5c59614d-c41e-4487-a006-acb1a5f89226 resource = Database result = Ok(()) uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzUxY2QyZC03YjFiLTRlYTAtOGI1YS02MjUyNTc3MmE1ZjUifX0%3D
25512025-06-04T15:47:29.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2802 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33622 req_id = 5c59614d-c41e-4487-a006-acb1a5f89226 response_code = 200 uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzUxY2QyZC03YjFiLTRlYTAtOGI1YS02MjUyNTc3MmE1ZjUifX0%3D
25522025-06-04T15:47:29.950ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 507 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = ec1ae01d-f265-453f-8c1f-6c19195ba43d response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
25532025-06-04T15:47:30.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4bf6a3ce-70f7-4ad4-8a23-62d5bb2ff86e roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25542025-06-04T15:47:30.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4bf6a3ce-70f7-4ad4-8a23-62d5bb2ff86e resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25552025-06-04T15:47:30.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4bf6a3ce-70f7-4ad4-8a23-62d5bb2ff86e response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25562025-06-04T15:47:31.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ef328c06-3af1-47e7-9ffe-c9f9555a1d87 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25572025-06-04T15:47:31.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ef328c06-3af1-47e7-9ffe-c9f9555a1d87 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25582025-06-04T15:47:31.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2522 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ef328c06-3af1-47e7-9ffe-c9f9555a1d87 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25592025-06-04T15:47:31.749ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
25602025-06-04T15:47:31.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25612025-06-04T15:47:31.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25622025-06-04T15:47:31.749ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
25632025-06-04T15:47:31.749ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25642025-06-04T15:47:31.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25652025-06-04T15:47:31.751ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25662025-06-04T15:47:31.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25672025-06-04T15:47:31.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25682025-06-04T15:47:31.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25692025-06-04T15:47:31.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25702025-06-04T15:47:31.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25712025-06-04T15:47:31.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25722025-06-04T15:47:31.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
25732025-06-04T15:47:31.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25742025-06-04T15:47:31.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25752025-06-04T15:47:31.773ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
25762025-06-04T15:47:31.773ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.117597ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
25772025-06-04T15:47:31.781ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25782025-06-04T15:47:31.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25792025-06-04T15:47:31.783ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.597673ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25802025-06-04T15:47:32.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f3754fb0-08ea-4d39-8f58-0ba89eb4e64b roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25812025-06-04T15:47:32.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f3754fb0-08ea-4d39-8f58-0ba89eb4e64b resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25822025-06-04T15:47:32.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f3754fb0-08ea-4d39-8f58-0ba89eb4e64b response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25832025-06-04T15:47:33.377ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 819ba797-f51f-4633-b363-42925ec3968b remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3f4764ee-ef75-4404-b6b8-4ab176abf4ae uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2025-06-04T15:47:33.377628777Z }
25842025-06-04T15:47:33.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3f4764ee-ef75-4404-b6b8-4ab176abf4ae roles = RoleSet { roles: {} } uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b
25852025-06-04T15:47:33.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3f4764ee-ef75-4404-b6b8-4ab176abf4ae resource = Database result = Ok(()) uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b
25862025-06-04T15:47:33.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 41171 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3f4764ee-ef75-4404-b6b8-4ab176abf4ae response_code = 204 uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b
25872025-06-04T15:47:34.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e279e139-b8b6-4487-a957-ef5555f6a706 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25882025-06-04T15:47:34.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e279e139-b8b6-4487-a957-ef5555f6a706 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25892025-06-04T15:47:34.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2564 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e279e139-b8b6-4487-a957-ef5555f6a706 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25902025-06-04T15:47:35.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = cd1b754f-9674-4614-9d77-97c1c15a5884 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25912025-06-04T15:47:35.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = cd1b754f-9674-4614-9d77-97c1c15a5884 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25922025-06-04T15:47:35.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2606 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = cd1b754f-9674-4614-9d77-97c1c15a5884 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
25932025-06-04T15:47:35.840ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 819ba797-f51f-4633-b363-42925ec3968b remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5e7f2967-16ee-4b99-8674-da31f49fc8a7 uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(6), time_updated: 2025-06-04T15:47:33.419235389Z }
25942025-06-04T15:47:35.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5e7f2967-16ee-4b99-8674-da31f49fc8a7 roles = RoleSet { roles: {} } uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b
25952025-06-04T15:47:35.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5e7f2967-16ee-4b99-8674-da31f49fc8a7 resource = Database result = Ok(()) uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b
25962025-06-04T15:47:35.849ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 819ba797-f51f-4633-b363-42925ec3968b remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5e7f2967-16ee-4b99-8674-da31f49fc8a7 uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b vmm_needs_update = true
25972025-06-04T15:47:35.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5e7f2967-16ee-4b99-8674-da31f49fc8a7 roles = RoleSet { roles: {} } uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b
25982025-06-04T15:47:35.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5e7f2967-16ee-4b99-8674-da31f49fc8a7 resource = Database result = Ok(()) uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b
25992025-06-04T15:47:35.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5e7f2967-16ee-4b99-8674-da31f49fc8a7 roles = RoleSet { roles: {} } uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b
26002025-06-04T15:47:35.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5e7f2967-16ee-4b99-8674-da31f49fc8a7 resource = Database result = Ok(()) uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b
26012025-06-04T15:47:35.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5e7f2967-16ee-4b99-8674-da31f49fc8a7 roles = RoleSet { roles: {} } uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b
26022025-06-04T15:47:35.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5e7f2967-16ee-4b99-8674-da31f49fc8a7 resource = Database result = Ok(()) uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b
26032025-06-04T15:47:35.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5e7f2967-16ee-4b99-8674-da31f49fc8a7 roles = RoleSet { roles: {} } uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b
26042025-06-04T15:47:35.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5e7f2967-16ee-4b99-8674-da31f49fc8a7 resource = Database result = Ok(()) uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b
26052025-06-04T15:47:35.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5e7f2967-16ee-4b99-8674-da31f49fc8a7 roles = RoleSet { roles: {} } uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b
26062025-06-04T15:47:35.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5e7f2967-16ee-4b99-8674-da31f49fc8a7 resource = Database result = Ok(()) uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b
26072025-06-04T15:47:35.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5e7f2967-16ee-4b99-8674-da31f49fc8a7 roles = RoleSet { roles: {} } uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b
26082025-06-04T15:47:35.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5e7f2967-16ee-4b99-8674-da31f49fc8a7 resource = Database result = Ok(()) uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b
26092025-06-04T15:47:35.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5e7f2967-16ee-4b99-8674-da31f49fc8a7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b
26102025-06-04T15:47:35.866ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5e7f2967-16ee-4b99-8674-da31f49fc8a7 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bcca9629-d8e0-4351-a4fb-8029b18eb633, lookup_type: ById(bcca9629-d8e0-4351-a4fb-8029b18eb633) }, key: bcd26e67-684b-4309-805e-e97d4ce4a896, lookup_type: ById(bcd26e67-684b-4309-805e-e97d4ce4a896) }, key: bd77d8d3-4e32-40e0-9702-2823b3ed4e49, lookup_type: ById(bd77d8d3-4e32-40e0-9702-2823b3ed4e49) } result = Ok(()) uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b
26112025-06-04T15:47:35.876ZINFOnexus (dropshot_internal): starting update saga for bd77d8d3-4e32-40e0-9702-2823b3ed4e49 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1603 instance_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5e7f2967-16ee-4b99-8674-da31f49fc8a7 uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(6), time_updated: 2025-06-04T15:47:33.419235389Z }
26122025-06-04T15:47:35.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 36917 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5e7f2967-16ee-4b99-8674-da31f49fc8a7 response_code = 204 uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b
26132025-06-04T15:47:35.876ZDEBGnexus (dropshot_internal): preparing instance-update saga for bd77d8d3-4e32-40e0-9702-2823b3ed4e49... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5e7f2967-16ee-4b99-8674-da31f49fc8a7 uri = /vmms/819ba797-f51f-4633-b363-42925ec3968b
26142025-06-04T15:47:35.876ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update
26152025-06-04T15:47:35.877ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"bd77d8d3-4e32-40e0-9702-2823b3ed4e49","lookup_type":{"ById":"bd77d8d3-4e32-40e0-9702-2823b3ed4e49"},"parent":{"key":"bcd26e67-684b-4309-805e-e97d4ce4a896","lookup_type":{"ById":"bcd26e67-684b-4309-805e-e97d4ce4a896"},"parent":{"key":"bcca9629-d8e0-4351-a4fb-8029b18eb633","lookup_type":{"ById":"bcca9629-d8e0-4351-a4fb-8029b18eb633"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
26162025-06-04T15:47:35.877ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update
26172025-06-04T15:47:35.922ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update
26182025-06-04T15:47:35.923ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
26192025-06-04T15:47:35.923ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
26202025-06-04T15:47:35.923ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011
26212025-06-04T15:47:35.930ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
26222025-06-04T15:47:35.930ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011
26232025-06-04T15:47:35.933ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
26242025-06-04T15:47:35.933ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011
26252025-06-04T15:47:35.940ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
26262025-06-04T15:47:35.940ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("d5e200c2-1265-486b-a436-1a400069c1ef")) node_id = 0 saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011
26272025-06-04T15:47:35.943ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
26282025-06-04T15:47:35.943ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011
26292025-06-04T15:47:35.957ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update
26302025-06-04T15:47:35.961ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = LockInstance
26312025-06-04T15:47:35.961ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = LockInstance
26322025-06-04T15:47:35.963ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = LockInstance
26332025-06-04T15:47:35.964ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = LockInstance
26342025-06-04T15:47:35.965ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = LockInstance
26352025-06-04T15:47:35.966ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = LockInstance
26362025-06-04T15:47:35.970ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = LockInstance
26372025-06-04T15:47:35.970ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = LockInstance
26382025-06-04T15:47:35.971ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = LockInstance
26392025-06-04T15:47:35.972ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = LockInstance
26402025-06-04T15:47:35.973ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = LockInstance
26412025-06-04T15:47:35.973ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = LockInstance
26422025-06-04T15:47:35.975ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = LockInstance
26432025-06-04T15:47:35.978ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bcca9629-d8e0-4351-a4fb-8029b18eb633, lookup_type: ById(bcca9629-d8e0-4351-a4fb-8029b18eb633) }, key: bcd26e67-684b-4309-805e-e97d4ce4a896, lookup_type: ById(bcd26e67-684b-4309-805e-e97d4ce4a896) }, key: bd77d8d3-4e32-40e0-9702-2823b3ed4e49, lookup_type: ById(bd77d8d3-4e32-40e0-9702-2823b3ed4e49) } result = Ok(()) saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = LockInstance
26442025-06-04T15:47:35.978ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = LockInstance updater_id = d5e200c2-1265-486b-a436-1a400069c1ef
26452025-06-04T15:47:35.978ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = LockInstance
26462025-06-04T15:47:35.979ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = LockInstance
26472025-06-04T15:47:35.992ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = LockInstance updater_id = d5e200c2-1265-486b-a436-1a400069c1ef
26482025-06-04T15:47:35.992ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = LockInstance
26492025-06-04T15:47:35.992ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = LockInstance
26502025-06-04T15:47:35.999ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 locked_gen = Generation(Generation(2)) saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = LockInstance updater_id = d5e200c2-1265-486b-a436-1a400069c1ef
26512025-06-04T15:47:36.006ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
26522025-06-04T15:47:36.006ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("d5e200c2-1265-486b-a436-1a400069c1ef")}) node_id = 1 saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011
26532025-06-04T15:47:36.009ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
26542025-06-04T15:47:36.009ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011
26552025-06-04T15:47:36.017ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
26562025-06-04T15:47:36.017ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
26572025-06-04T15:47:36.019ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
26582025-06-04T15:47:36.019ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
26592025-06-04T15:47:36.021ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
26602025-06-04T15:47:36.021ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
26612025-06-04T15:47:36.022ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
26622025-06-04T15:47:36.025ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bcca9629-d8e0-4351-a4fb-8029b18eb633, lookup_type: ById(bcca9629-d8e0-4351-a4fb-8029b18eb633) }, key: bcd26e67-684b-4309-805e-e97d4ce4a896, lookup_type: ById(bcd26e67-684b-4309-805e-e97d4ce4a896) }, key: bd77d8d3-4e32-40e0-9702-2823b3ed4e49, lookup_type: ById(bd77d8d3-4e32-40e0-9702-2823b3ed4e49) } result = Ok(()) saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
26632025-06-04T15:47:36.025ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
26642025-06-04T15:47:36.025ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
26652025-06-04T15:47:36.033ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 819ba797-f51f-4633-b363-42925ec3968b, time_created: 2025-06-04T15:47:15.245776Z, time_deleted: None, instance_id: bd77d8d3-4e32-40e0-9702-2823b3ed4e49, sled_id: e751cd2d-7b1b-4ea0-8b5a-62525772a5f5, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-06-04T15:47:33.419235Z, gen: Generation(Generation(6)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-06-04T15:47:13.161122Z, gen: Generation(Generation(3)), propolis_id: Some(819ba797-f51f-4633-b363-42925ec3968b), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(819ba797-f51f-4633-b363-42925ec3968b (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-06-04T15:47:36.033775374Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
26662025-06-04T15:47:36.038ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update
26672025-06-04T15:47:36.038ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"bd77d8d3-4e32-40e0-9702-2823b3ed4e49","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"819ba797-f51f-4633-b363-42925ec3968b"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"bd77d8d3-4e32-40e0-9702-2823b3ed4e49","lookup_type":{"ById":"bd77d8d3-4e32-40e0-9702-2823b3ed4e49"},"parent":{"key":"bcd26e67-684b-4309-805e-e97d4ce4a896","lookup_type":{"ById":"bcd26e67-684b-4309-805e-e97d4ce4a896"},"parent":{"key":"bcca9629-d8e0-4351-a4fb-8029b18eb633","lookup_type":{"ById":"bcca9629-d8e0-4351-a4fb-8029b18eb633"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"d5e200c2-1265-486b-a436-1a400069c1ef"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"bcd26e67-684b-4309-805e-e97d4ce4a896","ram_diff":1073741824},"destroy_active_vmm":"819ba797-f51f-4633-b363-42925ec3968b","destroy_target_vmm":null,"network_config":"Delete","new_intent":null,"new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-06-04T15:47:36.033775374Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
26682025-06-04T15:47:36.038ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update
26692025-06-04T15:47:36.042ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update
26702025-06-04T15:47:36.042ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
26712025-06-04T15:47:36.042ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
26722025-06-04T15:47:36.042ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
26732025-06-04T15:47:36.046ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
26742025-06-04T15:47:36.046ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
26752025-06-04T15:47:36.049ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
26762025-06-04T15:47:36.049ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
26772025-06-04T15:47:36.052ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
26782025-06-04T15:47:36.052ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("40cb2bc9-631a-41f8-97e6-992d49f182dc")) node_id = 0 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
26792025-06-04T15:47:36.055ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
26802025-06-04T15:47:36.055ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
26812025-06-04T15:47:36.058ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 parent_lock = UpdaterLock { updater_id: d5e200c2-1265-486b-a436-1a400069c1ef, locked_gen: Generation(Generation(2)) } saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update
26822025-06-04T15:47:36.058ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = BecomeUpdater
26832025-06-04T15:47:36.058ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = BecomeUpdater
26842025-06-04T15:47:36.067ZDEBGnexus (SagaExecutor): inherited lock from d5e200c2-1265-486b-a436-1a400069c1ef to 40cb2bc9-631a-41f8-97e6-992d49f182dc actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = d5e200c2-1265-486b-a436-1a400069c1ef saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = BecomeUpdater updater_id = 40cb2bc9-631a-41f8-97e6-992d49f182dc
26852025-06-04T15:47:36.067ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:987 instance_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update
26862025-06-04T15:47:36.067ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
26872025-06-04T15:47:36.067ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("40cb2bc9-631a-41f8-97e6-992d49f182dc")}) node_id = 1 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
26882025-06-04T15:47:36.071ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
26892025-06-04T15:47:36.071ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
26902025-06-04T15:47:36.074ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
26912025-06-04T15:47:36.074ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
26922025-06-04T15:47:36.076ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
26932025-06-04T15:47:36.076ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
26942025-06-04T15:47:36.079ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1040 instance_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update
26952025-06-04T15:47:36.082ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49
26962025-06-04T15:47:36.082ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = UpdateNetworkConfig
26972025-06-04T15:47:36.083ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = UpdateNetworkConfig
26982025-06-04T15:47:36.090ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = UpdateNetworkConfig
26992025-06-04T15:47:36.090ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = UpdateNetworkConfig
27002025-06-04T15:47:36.092ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
27012025-06-04T15:47:36.092ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = UpdateNetworkConfig
27022025-06-04T15:47:36.092ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = UpdateNetworkConfig
27032025-06-04T15:47:36.094ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
27042025-06-04T15:47:36.094ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
27052025-06-04T15:47:36.094ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
27062025-06-04T15:47:36.096ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
27072025-06-04T15:47:36.097ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
27082025-06-04T15:47:36.097ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
27092025-06-04T15:47:36.097ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
27102025-06-04T15:47:36.106ZDEBGnexus: notifying dendrite of updates instance_id = Some(bd77d8d3-4e32-40e0-9702-2823b3ed4e49 (instance)) switch = switch0
27112025-06-04T15:47:36.107ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2024, tv_nsec: 247407040 } })
27122025-06-04T15:47:36.109ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1179
27132025-06-04T15:47:36.139ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
27142025-06-04T15:47:36.139ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27152025-06-04T15:47:36.140ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "42416e56-0b27-4fde-9410-ccff742fa48c", "content-length": "26", "date": "Wed, 04 Jun 2025 15:47:36 GMT"} })
27162025-06-04T15:47:36.140ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27172025-06-04T15:47:36.140ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
27182025-06-04T15:47:36.171ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
27192025-06-04T15:47:36.171ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
27202025-06-04T15:47:36.174ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
27212025-06-04T15:47:36.174ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
27222025-06-04T15:47:36.180ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
27232025-06-04T15:47:36.180ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
27242025-06-04T15:47:36.206ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1115 instance_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-06-04T15:47:36.183999Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: bcca9629-d8e0-4351-a4fb-8029b18eb633, time_modified: Some(2025-06-04T15:47:36.183999Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: bcd26e67-684b-4309-805e-e97d4ce4a896, time_modified: Some(2025-06-04T15:47:36.183999Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update
27252025-06-04T15:47:36.206ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
27262025-06-04T15:47:36.206ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
27272025-06-04T15:47:36.209ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
27282025-06-04T15:47:36.209ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
27292025-06-04T15:47:36.214ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1150 instance_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update
27302025-06-04T15:47:36.214ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = UnassignOximeterProducer
27312025-06-04T15:47:36.214ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = UnassignOximeterProducer
27322025-06-04T15:47:36.221ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 93dd7779-b561-4a6e-a81b-f44350333434 producer_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update
27332025-06-04T15:47:36.221ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = UnassignOximeterProducer
27342025-06-04T15:47:36.221ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = UnassignOximeterProducer
27352025-06-04T15:47:36.255ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update
27362025-06-04T15:47:36.255ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/bd77d8d3-4e32-40e0-9702-2823b3ed4e49
27372025-06-04T15:47:36.275ZDEBGnexus (SagaExecutor): client response oximeter-collector = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/bd77d8d3-4e32-40e0-9702-2823b3ed4e49", status: 204, headers: {"x-request-id": "8360ae48-31a2-4847-ac6f-edd255d458de", "date": "Wed, 04 Jun 2025 15:47:36 GMT"} }) saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update
27382025-06-04T15:47:36.275ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 93dd7779-b561-4a6e-a81b-f44350333434 producer_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update
27392025-06-04T15:47:36.276ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
27402025-06-04T15:47:36.276ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
27412025-06-04T15:47:36.280ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
27422025-06-04T15:47:36.280ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
27432025-06-04T15:47:36.283ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 lock = UpdaterLock { updater_id: 40cb2bc9-631a-41f8-97e6-992d49f182dc, locked_gen: Generation(Generation(3)) } new_intent = None new_runtime = InstanceRuntimeState { time_updated: 2025-06-04T15:47:36.033775374Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update
27442025-06-04T15:47:36.283ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = CommitInstanceUpdates
27452025-06-04T15:47:36.283ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = CommitInstanceUpdates
27462025-06-04T15:47:36.327ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1201 instance_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 new_runtime = InstanceRuntimeState { time_updated: 2025-06-04T15:47:36.033775374Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update
27472025-06-04T15:47:36.327ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
27482025-06-04T15:47:36.327ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
27492025-06-04T15:47:36.327ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Signaled
27502025-06-04T15:47:36.327ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Signaled
27512025-06-04T15:47:36.327ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
27522025-06-04T15:47:36.327ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27532025-06-04T15:47:36.327ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27542025-06-04T15:47:36.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27552025-06-04T15:47:36.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27562025-06-04T15:47:36.329ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27572025-06-04T15:47:36.330ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
27582025-06-04T15:47:36.330ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
27592025-06-04T15:47:36.331ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27602025-06-04T15:47:36.331ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27612025-06-04T15:47:36.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27622025-06-04T15:47:36.332ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27632025-06-04T15:47:36.333ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
27642025-06-04T15:47:36.333ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("bd77d8d3-4e32-40e0-9702-2823b3ed4e49"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("819ba797-f51f-4633-b363-42925ec3968b")}) node_id = 7 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
27652025-06-04T15:47:36.334ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
27662025-06-04T15:47:36.334ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27672025-06-04T15:47:36.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27682025-06-04T15:47:36.336ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
27692025-06-04T15:47:36.336ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
27702025-06-04T15:47:36.339ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
27712025-06-04T15:47:36.339ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
27722025-06-04T15:47:36.342ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
27732025-06-04T15:47:36.342ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
27742025-06-04T15:47:36.345ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:82 instance_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 propolis_id = 819ba797-f51f-4633-b363-42925ec3968b saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update
27752025-06-04T15:47:36.345ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = ReleaseSledResources
27762025-06-04T15:47:36.345ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = ReleaseSledResources
27772025-06-04T15:47:36.358ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
27782025-06-04T15:47:36.358ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
27792025-06-04T15:47:36.371ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
27802025-06-04T15:47:36.371ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27812025-06-04T15:47:36.371ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4da74f33-55ca-4c57-9954-5a47eebbe796", "content-length": "372", "date": "Wed, 04 Jun 2025 15:47:36 GMT"} })
27822025-06-04T15:47:36.371ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27832025-06-04T15:47:36.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27842025-06-04T15:47:36.374ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
27852025-06-04T15:47:36.375ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
27862025-06-04T15:47:36.376ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27872025-06-04T15:47:36.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27882025-06-04T15:47:36.377ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:113 instance_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 propolis_id = 819ba797-f51f-4633-b363-42925ec3968b saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update
27892025-06-04T15:47:36.377ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = MarkVmmDeleted
27902025-06-04T15:47:36.378ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = MarkVmmDeleted
27912025-06-04T15:47:36.388ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
27922025-06-04T15:47:36.388ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
27932025-06-04T15:47:36.391ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
27942025-06-04T15:47:36.391ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
27952025-06-04T15:47:36.395ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
27962025-06-04T15:47:36.395ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
27972025-06-04T15:47:36.397ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
27982025-06-04T15:47:36.397ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
27992025-06-04T15:47:36.401ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = ChainSuccessorSaga
28002025-06-04T15:47:36.401ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = ChainSuccessorSaga
28012025-06-04T15:47:36.403ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = ChainSuccessorSaga
28022025-06-04T15:47:36.403ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = ChainSuccessorSaga
28032025-06-04T15:47:36.404ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = ChainSuccessorSaga
28042025-06-04T15:47:36.404ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = ChainSuccessorSaga
28052025-06-04T15:47:36.406ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = ChainSuccessorSaga
28062025-06-04T15:47:36.410ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bcca9629-d8e0-4351-a4fb-8029b18eb633, lookup_type: ById(bcca9629-d8e0-4351-a4fb-8029b18eb633) }, key: bcd26e67-684b-4309-805e-e97d4ce4a896, lookup_type: ById(bcd26e67-684b-4309-805e-e97d4ce4a896) }, key: bd77d8d3-4e32-40e0-9702-2823b3ed4e49, lookup_type: ById(bd77d8d3-4e32-40e0-9702-2823b3ed4e49) } result = Ok(()) saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = ChainSuccessorSaga
28072025-06-04T15:47:36.410ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = ChainSuccessorSaga
28082025-06-04T15:47:36.410ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_node = ChainSuccessorSaga
28092025-06-04T15:47:36.416ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 intended_state = destroyed karmic_state = WillReincarnate needs_reincarnation = false saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update
28102025-06-04T15:47:36.416ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
28112025-06-04T15:47:36.416ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
28122025-06-04T15:47:36.419ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28132025-06-04T15:47:36.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28142025-06-04T15:47:36.420ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
28152025-06-04T15:47:36.420ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
28162025-06-04T15:47:36.421ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28172025-06-04T15:47:36.423ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28182025-06-04T15:47:36.423ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28192025-06-04T15:47:36.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28202025-06-04T15:47:36.423ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
28212025-06-04T15:47:36.423ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
28222025-06-04T15:47:36.424ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28232025-06-04T15:47:36.426ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
28242025-06-04T15:47:36.426ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844
28252025-06-04T15:47:36.426ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28262025-06-04T15:47:36.426ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28272025-06-04T15:47:36.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28282025-06-04T15:47:36.435ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
28292025-06-04T15:47:36.435ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
28302025-06-04T15:47:36.435ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "779a011a-f3ef-43bc-9f4e-3fe679c5ee9e", "date": "Wed, 04 Jun 2025 15:47:36 GMT"} })
28312025-06-04T15:47:36.435ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28322025-06-04T15:47:36.435ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
28332025-06-04T15:47:36.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28342025-06-04T15:47:36.435ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 saga_name = instance-update saga_result = SagaResult { saga_id: d9fae04a-32e5-47c5-9308-cb56b3e4f844, saga_log: SagaLog { saga_id: d9fae04a-32e5-47c5-9308-cb56b3e4f844, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("40cb2bc9-631a-41f8-97e6-992d49f182dc")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("40cb2bc9-631a-41f8-97e6-992d49f182dc")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("bd77d8d3-4e32-40e0-9702-2823b3ed4e49"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("819ba797-f51f-4633-b363-42925ec3968b")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("bd77d8d3-4e32-40e0-9702-2823b3ed4e49"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("819ba797-f51f-4633-b363-42925ec3968b")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("40cb2bc9-631a-41f8-97e6-992d49f182dc"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("40cb2bc9-631a-41f8-97e6-992d49f182dc")}} }) }
28352025-06-04T15:47:36.435ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = d9fae04a-32e5-47c5-9308-cb56b3e4f844 instance_id = bd77d8d3-4e32-40e0-9702-2823b3ed4e49 saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update
28362025-06-04T15:47:36.435ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
28372025-06-04T15:47:36.435ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011
28382025-06-04T15:47:36.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28392025-06-04T15:47:36.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28402025-06-04T15:47:36.440ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
28412025-06-04T15:47:36.440ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011
28422025-06-04T15:47:36.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28432025-06-04T15:47:36.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28442025-06-04T15:47:36.443ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
28452025-06-04T15:47:36.443ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011
28462025-06-04T15:47:36.459ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
28472025-06-04T15:47:36.459ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0a544c5-4c05-4468-aeb2-90d4740caac9", "content-length": "691", "date": "Wed, 04 Jun 2025 15:47:36 GMT"} })
28482025-06-04T15:47:36.459ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
28492025-06-04T15:47:36.459ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
28502025-06-04T15:47:36.459ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
28512025-06-04T15:47:36.462ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 134.99225ms iteration = 25 status = {}
28522025-06-04T15:47:36.462ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
28532025-06-04T15:47:36.462ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28542025-06-04T15:47:36.463ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7042593f-5c75-4946-9f7a-1b22c7165ea1", "date": "Wed, 04 Jun 2025 15:47:36 GMT"} })
28552025-06-04T15:47:36.463ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
28562025-06-04T15:47:36.463ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011
28572025-06-04T15:47:36.465ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 138.037978ms iteration = 25 status = {}
28582025-06-04T15:47:36.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 995a4fc5-c306-4007-a9d2-d563ba5726e0 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
28592025-06-04T15:47:36.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 995a4fc5-c306-4007-a9d2-d563ba5726e0 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
28602025-06-04T15:47:36.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 995a4fc5-c306-4007-a9d2-d563ba5726e0 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
28612025-06-04T15:47:36.498ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update sec_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
28622025-06-04T15:47:36.498ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 22a1aba9-f12f-4ff8-add1-52548fac9011 saga_name = start-instance-update saga_result = SagaResult { saga_id: 22a1aba9-f12f-4ff8-add1-52548fac9011, saga_log: SagaLog { saga_id: 22a1aba9-f12f-4ff8-add1-52548fac9011, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("d5e200c2-1265-486b-a436-1a400069c1ef")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("d5e200c2-1265-486b-a436-1a400069c1ef")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("d5e200c2-1265-486b-a436-1a400069c1ef"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("d5e200c2-1265-486b-a436-1a400069c1ef")}} }) }
28632025-06-04T15:47:37.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 664aab18-3d00-4d65-8155-687aad256968 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
28642025-06-04T15:47:37.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 664aab18-3d00-4d65-8155-687aad256968 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
28652025-06-04T15:47:37.487ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1771 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 664aab18-3d00-4d65-8155-687aad256968 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
28662025-06-04T15:47:38.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 557eb8ea-8bb9-4d14-b2aa-7c9e83660b4e roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
28672025-06-04T15:47:38.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 557eb8ea-8bb9-4d14-b2aa-7c9e83660b4e resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
28682025-06-04T15:47:38.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 557eb8ea-8bb9-4d14-b2aa-7c9e83660b4e response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
28692025-06-04T15:47:39.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f6c08a26-d607-438d-bea3-be8faa5ae653 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
28702025-06-04T15:47:39.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f6c08a26-d607-438d-bea3-be8faa5ae653 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
28712025-06-04T15:47:39.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2774 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f6c08a26-d607-438d-bea3-be8faa5ae653 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
28722025-06-04T15:47:39.950ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 567 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = 9056b2f4-573c-42b3-b832-95205e1aa9ad response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
28732025-06-04T15:47:40.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3862bd5f-1370-4c46-abf0-547f974a5fb1 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
28742025-06-04T15:47:40.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3862bd5f-1370-4c46-abf0-547f974a5fb1 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
28752025-06-04T15:47:40.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3862bd5f-1370-4c46-abf0-547f974a5fb1 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
28762025-06-04T15:47:41.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7a250a77-7cbe-4d32-94d0-6da0b79ec980 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
28772025-06-04T15:47:41.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7a250a77-7cbe-4d32-94d0-6da0b79ec980 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
28782025-06-04T15:47:41.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7a250a77-7cbe-4d32-94d0-6da0b79ec980 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
28792025-06-04T15:47:41.749ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
28802025-06-04T15:47:41.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28812025-06-04T15:47:41.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28822025-06-04T15:47:41.749ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
28832025-06-04T15:47:41.749ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28842025-06-04T15:47:41.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28852025-06-04T15:47:41.751ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28862025-06-04T15:47:41.751ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28872025-06-04T15:47:41.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28882025-06-04T15:47:41.753ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.883897ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28892025-06-04T15:47:41.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28902025-06-04T15:47:41.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28912025-06-04T15:47:41.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28922025-06-04T15:47:41.755ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28932025-06-04T15:47:41.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28942025-06-04T15:47:41.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28952025-06-04T15:47:41.759ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
28962025-06-04T15:47:41.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28972025-06-04T15:47:41.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28982025-06-04T15:47:41.767ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
28992025-06-04T15:47:41.767ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.270294ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
29002025-06-04T15:47:42.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a4daf635-4812-454d-87d0-4131db8cb5ec roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29012025-06-04T15:47:42.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a4daf635-4812-454d-87d0-4131db8cb5ec resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29022025-06-04T15:47:42.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a4daf635-4812-454d-87d0-4131db8cb5ec response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29032025-06-04T15:47:43.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2ae879a8-e134-4ca5-afcf-4a6eb7c231b1 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29042025-06-04T15:47:43.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2ae879a8-e134-4ca5-afcf-4a6eb7c231b1 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29052025-06-04T15:47:43.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2713 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2ae879a8-e134-4ca5-afcf-4a6eb7c231b1 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29062025-06-04T15:47:44.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = fe884ede-f834-4bfc-b147-dceeda5ba53b roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29072025-06-04T15:47:44.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = fe884ede-f834-4bfc-b147-dceeda5ba53b resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29082025-06-04T15:47:44.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2612 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = fe884ede-f834-4bfc-b147-dceeda5ba53b response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29092025-06-04T15:47:45.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e3673abf-f35a-40eb-ba96-b01476a68b93 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29102025-06-04T15:47:45.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e3673abf-f35a-40eb-ba96-b01476a68b93 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29112025-06-04T15:47:45.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e3673abf-f35a-40eb-ba96-b01476a68b93 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29122025-06-04T15:47:46.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4e0f2a6f-2405-4489-8fbb-25db2a5ced18 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29132025-06-04T15:47:46.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4e0f2a6f-2405-4489-8fbb-25db2a5ced18 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29142025-06-04T15:47:46.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2221 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4e0f2a6f-2405-4489-8fbb-25db2a5ced18 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29152025-06-04T15:47:47.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b8440d05-8ec9-401d-a6af-c9224c7cad7e roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29162025-06-04T15:47:47.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b8440d05-8ec9-401d-a6af-c9224c7cad7e resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29172025-06-04T15:47:47.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b8440d05-8ec9-401d-a6af-c9224c7cad7e response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29182025-06-04T15:47:48.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0003d8e2-391b-4adb-a6ef-dbebc33676e7 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29192025-06-04T15:47:48.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0003d8e2-391b-4adb-a6ef-dbebc33676e7 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29202025-06-04T15:47:48.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0003d8e2-391b-4adb-a6ef-dbebc33676e7 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29212025-06-04T15:47:49.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2ca60b0a-c6d9-4371-815a-b8707c16d2af roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29222025-06-04T15:47:49.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2ca60b0a-c6d9-4371-815a-b8707c16d2af resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29232025-06-04T15:47:49.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2ca60b0a-c6d9-4371-815a-b8707c16d2af response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29242025-06-04T15:47:49.951ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 624 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = 3e73f2f2-253e-4ff5-bf7c-25f40875a020 response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
29252025-06-04T15:47:50.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7b9173c3-3eb6-441f-9c25-b6924e065bb4 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29262025-06-04T15:47:50.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7b9173c3-3eb6-441f-9c25-b6924e065bb4 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29272025-06-04T15:47:50.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2618 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7b9173c3-3eb6-441f-9c25-b6924e065bb4 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29282025-06-04T15:47:51.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6a608ec9-dd57-474f-9eb9-a5b14f61c843 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29292025-06-04T15:47:51.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6a608ec9-dd57-474f-9eb9-a5b14f61c843 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29302025-06-04T15:47:51.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6a608ec9-dd57-474f-9eb9-a5b14f61c843 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
29312025-06-04T15:47:51.747ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
29322025-06-04T15:47:51.747ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
29332025-06-04T15:47:51.747ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
29342025-06-04T15:47:51.747ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
29352025-06-04T15:47:51.747ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
29362025-06-04T15:47:51.747ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-04 15:37:51.747787195 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
29372025-06-04T15:47:51.747ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
29382025-06-04T15:47:51.747ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
29392025-06-04T15:47:51.747ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29402025-06-04T15:47:51.747ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
29412025-06-04T15:47:51.747ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
29422025-06-04T15:47:51.747ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
29432025-06-04T15:47:51.747ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
29442025-06-04T15:47:51.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29452025-06-04T15:47:51.747ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
29462025-06-04T15:47:51.747ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
29472025-06-04T15:47:51.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29482025-06-04T15:47:51.747ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
29492025-06-04T15:47:51.747ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29502025-06-04T15:47:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
29512025-06-04T15:47:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
29522025-06-04T15:47:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29532025-06-04T15:47:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29542025-06-04T15:47:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29552025-06-04T15:47:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29562025-06-04T15:47:51.748ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("74458287-879a-4471-829f-da352f40aff2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("84104d89-910f-45b9-adb6-d23a6d4f41d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("84104d89-910f-45b9-adb6-d23a6d4f41d6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2039, tv_nsec: 888719130 } })
29572025-06-04T15:47:51.748ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d97642c-17fd-4803-bc28-7ad83219ce8c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("91bdae66-8e10-4892-9bfd-517dee32a9bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e10264ea-c7fb-4742-9452-fa5e125ebf3d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e10264ea-c7fb-4742-9452-fa5e125ebf3d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2039, tv_nsec: 888764050 } })
29582025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
29592025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
29602025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29612025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
29622025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
29632025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29642025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
29652025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
29662025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
29672025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29682025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
29692025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29702025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
29712025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29722025-06-04T15:47:51.749ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf
29732025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.36\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf"}
29742025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
29752025-06-04T15:47:51.749ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
29762025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
29772025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
29782025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.409397ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
29792025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
29802025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.536629ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
29812025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29822025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29832025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29842025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29852025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29862025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
29872025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29882025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
29892025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29902025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
29912025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29922025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
29932025-06-04T15:47:51.749ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29942025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29952025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
29962025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29972025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29982025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
29992025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30002025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
30012025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
30022025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
30032025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30042025-06-04T15:47:51.750ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
30052025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30062025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
30072025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30082025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
30092025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
30102025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
30112025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
30122025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30132025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30142025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30152025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30162025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30172025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30182025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30192025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30202025-06-04T15:47:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
30212025-06-04T15:47:51.752ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30222025-06-04T15:47:51.752ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-04 15:37:51.747787195 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
30232025-06-04T15:47:51.752ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.692098ms iteration = 13 status = {"expiration":"2025-06-04T15:37:51.747787195Z","pruned":[]}
30242025-06-04T15:47:51.753ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2039, tv_nsec: 893369557 } })
30252025-06-04T15:47:51.753ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30262025-06-04T15:47:51.753ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
30272025-06-04T15:47:51.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30282025-06-04T15:47:51.754ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
30292025-06-04T15:47:51.754ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30302025-06-04T15:47:51.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30312025-06-04T15:47:51.754ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2039, tv_nsec: 894857165 } })
30322025-06-04T15:47:51.754ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
30332025-06-04T15:47:51.754ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30342025-06-04T15:47:51.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30352025-06-04T15:47:51.756ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.35199ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
30362025-06-04T15:47:51.756ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30372025-06-04T15:47:51.757ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30382025-06-04T15:47:51.757ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30392025-06-04T15:47:51.757ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
30402025-06-04T15:47:51.757ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30412025-06-04T15:47:51.757ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
30422025-06-04T15:47:51.757ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
30432025-06-04T15:47:51.757ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
30442025-06-04T15:47:51.757ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
30452025-06-04T15:47:51.757ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
30462025-06-04T15:47:51.757ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
30472025-06-04T15:47:51.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
30482025-06-04T15:47:51.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30492025-06-04T15:47:51.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
30502025-06-04T15:47:51.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
30512025-06-04T15:47:51.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30522025-06-04T15:47:51.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
30532025-06-04T15:47:51.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
30542025-06-04T15:47:51.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
30552025-06-04T15:47:51.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
30562025-06-04T15:47:51.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30572025-06-04T15:47:51.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
30582025-06-04T15:47:51.759ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30592025-06-04T15:47:51.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30602025-06-04T15:47:51.760ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30612025-06-04T15:47:51.761ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
30622025-06-04T15:47:51.761ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30632025-06-04T15:47:51.761ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30642025-06-04T15:47:51.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30652025-06-04T15:47:51.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30662025-06-04T15:47:51.761ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
30672025-06-04T15:47:51.761ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30682025-06-04T15:47:51.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30692025-06-04T15:47:51.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30702025-06-04T15:47:51.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
30712025-06-04T15:47:51.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30722025-06-04T15:47:51.762ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 25 reason = Timeout
30732025-06-04T15:47:51.762ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 13 reason = Timeout
30742025-06-04T15:47:51.762ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
30752025-06-04T15:47:51.762ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
30762025-06-04T15:47:51.762ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 13 reason = Timeout
30772025-06-04T15:47:51.762ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
30782025-06-04T15:47:51.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30792025-06-04T15:47:51.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
30802025-06-04T15:47:51.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
30812025-06-04T15:47:51.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
30822025-06-04T15:47:51.763ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30832025-06-04T15:47:51.763ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30842025-06-04T15:47:51.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30852025-06-04T15:47:51.763ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30862025-06-04T15:47:51.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30872025-06-04T15:47:51.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
30882025-06-04T15:47:51.765ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
30892025-06-04T15:47:51.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
30902025-06-04T15:47:51.765ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30912025-06-04T15:47:51.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
30922025-06-04T15:47:51.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30932025-06-04T15:47:51.766ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30942025-06-04T15:47:51.767ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30952025-06-04T15:47:51.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
30962025-06-04T15:47:51.768ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30972025-06-04T15:47:51.768ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30982025-06-04T15:47:51.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30992025-06-04T15:47:51.768ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31002025-06-04T15:47:51.770ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31012025-06-04T15:47:51.771ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
31022025-06-04T15:47:51.771ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31032025-06-04T15:47:51.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31042025-06-04T15:47:51.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
31052025-06-04T15:47:51.772ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31062025-06-04T15:47:51.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31072025-06-04T15:47:51.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31082025-06-04T15:47:51.773ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31092025-06-04T15:47:51.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
31102025-06-04T15:47:51.773ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31112025-06-04T15:47:51.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
31122025-06-04T15:47:51.774ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
31132025-06-04T15:47:51.774ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
31142025-06-04T15:47:51.774ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
31152025-06-04T15:47:51.774ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31162025-06-04T15:47:51.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31172025-06-04T15:47:51.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
31182025-06-04T15:47:51.775ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31192025-06-04T15:47:51.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31202025-06-04T15:47:51.778ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31212025-06-04T15:47:51.779ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31222025-06-04T15:47:51.779ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31232025-06-04T15:47:51.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
31242025-06-04T15:47:51.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31252025-06-04T15:47:51.780ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 22.153353ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
31262025-06-04T15:47:51.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31272025-06-04T15:47:51.784ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 26.241043ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
31282025-06-04T15:47:51.784ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 26.325374ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
31292025-06-04T15:47:51.785ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31302025-06-04T15:47:51.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31312025-06-04T15:47:51.786ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31322025-06-04T15:47:51.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31332025-06-04T15:47:51.788ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31342025-06-04T15:47:51.788ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2039, tv_nsec: 928725811 } })
31352025-06-04T15:47:51.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31362025-06-04T15:47:51.788ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
31372025-06-04T15:47:51.790ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31382025-06-04T15:47:51.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31392025-06-04T15:47:51.798ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
31402025-06-04T15:47:51.798ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 36.854113ms iteration = 13 status = {"by_rx":{},"error":null}
31412025-06-04T15:47:51.803ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 54.256767ms iteration = 6 status = {"nsuccess":5}
31422025-06-04T15:47:51.804ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31432025-06-04T15:47:51.806ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
31442025-06-04T15:47:51.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
31452025-06-04T15:47:51.807ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
31462025-06-04T15:47:51.807ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 57.075512ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
31472025-06-04T15:47:51.810ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
31482025-06-04T15:47:51.810ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31492025-06-04T15:47:51.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31502025-06-04T15:47:51.812ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31512025-06-04T15:47:51.814ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 52.150751ms iteration = 13 status = {"dispatched":[],"errors":[],"glob_version":"147.0.0","globs_reprocessed":{},"no_receivers":[]}
31522025-06-04T15:47:51.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
31532025-06-04T15:47:51.816ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31542025-06-04T15:47:51.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31552025-06-04T15:47:51.820ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
31562025-06-04T15:47:51.820ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
31572025-06-04T15:47:51.820ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 62.480118ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
31582025-06-04T15:47:51.822ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31592025-06-04T15:47:51.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31602025-06-04T15:47:51.824ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31612025-06-04T15:47:51.827ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31622025-06-04T15:47:51.827ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31632025-06-04T15:47:51.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31642025-06-04T15:47:51.828ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
31652025-06-04T15:47:51.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
31662025-06-04T15:47:51.832ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31672025-06-04T15:47:51.834ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31682025-06-04T15:47:51.835ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31692025-06-04T15:47:51.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31702025-06-04T15:47:51.836ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31712025-06-04T15:47:51.836ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31722025-06-04T15:47:51.836ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31732025-06-04T15:47:51.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31742025-06-04T15:47:51.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31752025-06-04T15:47:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
31762025-06-04T15:47:51.838ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
31772025-06-04T15:47:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
31782025-06-04T15:47:51.839ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
31792025-06-04T15:47:51.839ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
31802025-06-04T15:47:51.839ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
31812025-06-04T15:47:51.839ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31822025-06-04T15:47:51.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31832025-06-04T15:47:51.840ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 90.151229ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
31842025-06-04T15:47:51.842ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31852025-06-04T15:47:51.842ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
31862025-06-04T15:47:51.842ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31872025-06-04T15:47:51.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31882025-06-04T15:47:51.846ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
31892025-06-04T15:47:51.846ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
31902025-06-04T15:47:51.846ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 97.141334ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
31912025-06-04T15:47:51.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31922025-06-04T15:47:51.846ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31932025-06-04T15:47:51.846ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 84.900404ms iteration = 25 status = {"errors":[],"requests_created_ok":[]}
31942025-06-04T15:47:51.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31952025-06-04T15:47:51.847ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
31962025-06-04T15:47:51.847ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
31972025-06-04T15:47:51.847ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31982025-06-04T15:47:51.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
31992025-06-04T15:47:51.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32002025-06-04T15:47:51.849ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32012025-06-04T15:47:51.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32022025-06-04T15:47:51.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32032025-06-04T15:47:51.850ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32042025-06-04T15:47:51.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32052025-06-04T15:47:51.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32062025-06-04T15:47:51.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32072025-06-04T15:47:51.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e751cd2d-7b1b-4ea0-8b5a-62525772a5f5, lookup_type: ById(e751cd2d-7b1b-4ea0-8b5a-62525772a5f5) } result = Ok(())
32082025-06-04T15:47:51.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32092025-06-04T15:47:51.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32102025-06-04T15:47:51.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32112025-06-04T15:47:51.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32122025-06-04T15:47:51.861ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32132025-06-04T15:47:51.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32142025-06-04T15:47:51.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32152025-06-04T15:47:51.862ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32162025-06-04T15:47:51.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32172025-06-04T15:47:51.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
32182025-06-04T15:47:51.864ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32192025-06-04T15:47:51.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32202025-06-04T15:47:51.869ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32212025-06-04T15:47:51.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32222025-06-04T15:47:51.884ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 134.20988ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32232025-06-04T15:47:51.884ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
32242025-06-04T15:47:51.884ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 135.724509ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
32252025-06-04T15:47:51.884ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32262025-06-04T15:47:51.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32272025-06-04T15:47:51.889ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32282025-06-04T15:47:51.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32292025-06-04T15:47:51.892ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 134.952149ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32302025-06-04T15:47:51.893ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32312025-06-04T15:47:51.893ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
32322025-06-04T15:47:51.893ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 142.826317ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
32332025-06-04T15:47:51.904ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
32342025-06-04T15:47:51.912ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
32352025-06-04T15:47:51.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
32362025-06-04T15:47:51.961ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 212.160529ms iteration = 28 status = {"physical_disks_added":0}
32372025-06-04T15:47:51.996ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
32382025-06-04T15:47:52.087ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
32392025-06-04T15:47:52.087ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32402025-06-04T15:47:52.087ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "61571263-a92e-4a0e-9ca8-2b0c3d9f17dc", "content-length": "26", "date": "Wed, 04 Jun 2025 15:47:52 GMT"} })
32412025-06-04T15:47:52.087ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32422025-06-04T15:47:52.089ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32432025-06-04T15:47:52.103ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
32442025-06-04T15:47:52.103ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32452025-06-04T15:47:52.103ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3982f86-2a57-41e1-bc8c-d2d0046140f9", "content-length": "26", "date": "Wed, 04 Jun 2025 15:47:52 GMT"} })
32462025-06-04T15:47:52.103ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32472025-06-04T15:47:52.105ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32482025-06-04T15:47:52.141ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
32492025-06-04T15:47:52.141ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "49f79cda-bdf1-4e1e-9cda-cd19ed6f8696", "date": "Wed, 04 Jun 2025 15:47:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
32502025-06-04T15:47:52.141ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
32512025-06-04T15:47:52.143ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d0649b58-652b-4c0c-b29b-009785c877cd", "date": "Wed, 04 Jun 2025 15:47:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
32522025-06-04T15:47:52.143ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
32532025-06-04T15:47:52.145ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
32542025-06-04T15:47:52.145ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 397.594719ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
32552025-06-04T15:47:52.157ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 zone_address = fd00:1122:3344:101::2
32562025-06-04T15:47:52.157ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32572025-06-04T15:47:52.158ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c71525b5-7003-44bf-b1d6-2f6340304e03", "content-length": "26", "date": "Wed, 04 Jun 2025 15:47:52 GMT"} })
32582025-06-04T15:47:52.158ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32592025-06-04T15:47:52.159ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
32602025-06-04T15:47:52.169ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
32612025-06-04T15:47:52.169ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
32622025-06-04T15:47:52.169ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e07c69f5-7228-4cd9-9530-0b9cbafd02ac", "content-length": "372", "date": "Wed, 04 Jun 2025 15:47:51 GMT"} })
32632025-06-04T15:47:52.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32642025-06-04T15:47:52.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32652025-06-04T15:47:52.171ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 422.403783ms iteration = 25 status = 0
32662025-06-04T15:47:52.202ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 444.961051ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
32672025-06-04T15:47:52.204ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
32682025-06-04T15:47:52.205ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3d7e8dc-2bc9-44b8-ab19-be7ae06c6ffb", "content-length": "691", "date": "Wed, 04 Jun 2025 15:47:51 GMT"} })
32692025-06-04T15:47:52.205ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
32702025-06-04T15:47:52.205ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
32712025-06-04T15:47:52.205ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
32722025-06-04T15:47:52.207ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32732025-06-04T15:47:52.207ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 456.677705ms iteration = 26 status = {}
32742025-06-04T15:47:52.208ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
32752025-06-04T15:47:52.208ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3a2843d7-1e1c-47e4-9521-1eb938c0106b dns_zone_name = oxide.test found_so_far = 0 version = 2
32762025-06-04T15:47:52.208ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32772025-06-04T15:47:52.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32782025-06-04T15:47:52.209ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32792025-06-04T15:47:52.209ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32802025-06-04T15:47:52.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32812025-06-04T15:47:52.211ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32822025-06-04T15:47:52.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32832025-06-04T15:47:52.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32842025-06-04T15:47:52.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32852025-06-04T15:47:52.217ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3a2843d7-1e1c-47e4-9521-1eb938c0106b dns_zone_name = oxide.test found_so_far = 4 version = 2
32862025-06-04T15:47:52.217ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
32872025-06-04T15:47:52.217ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-04 15:35:55.637968 UTC dns_group = external generation = 2
32882025-06-04T15:47:52.217ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 469.189269ms iteration = 13 status = {"generation":2}
32892025-06-04T15:47:52.217ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
32902025-06-04T15:47:52.217ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 468.308847ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
32912025-06-04T15:47:52.227ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
32922025-06-04T15:47:52.237ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
32932025-06-04T15:47:52.237ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 4b1484ba-d395-4f36-93b6-c834b9680ee9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
32942025-06-04T15:47:52.237ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32952025-06-04T15:47:52.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32962025-06-04T15:47:52.238ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32972025-06-04T15:47:52.241ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 493.443647ms iteration = 25 status = {}
32982025-06-04T15:47:52.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32992025-06-04T15:47:52.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33002025-06-04T15:47:52.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33012025-06-04T15:47:52.244ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 4b1484ba-d395-4f36-93b6-c834b9680ee9 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
33022025-06-04T15:47:52.244ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
33032025-06-04T15:47:52.244ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-04 15:35:53.349408 UTC dns_group = internal generation = 1
33042025-06-04T15:47:52.244ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 496.235611ms iteration = 13 status = {"generation":1}
33052025-06-04T15:47:52.246ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-04T15:35:43.043689Z, time_modified: 2025-06-04T15:35:43.043689Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: bcca9629-d8e0-4351-a4fb-8029b18eb633, db_silo: Silo { identity: SiloIdentity { id: bcca9629-d8e0-4351-a4fb-8029b18eb633, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-04T15:35:55.573183Z, time_modified: 2025-06-04T15:35:55.573183Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a49af7a2313337b84535ddab02a38b7781b3f7789d0df44311ad2658fa92170d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: bcca9629-d8e0-4351-a4fb-8029b18eb633, db_silo: Silo { identity: SiloIdentity { id: bcca9629-d8e0-4351-a4fb-8029b18eb633, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-04T15:35:55.573183Z, time_modified: 2025-06-04T15:35:55.573183Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a49af7a2313337b84535ddab02a38b7781b3f7789d0df44311ad2658fa92170d" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
33062025-06-04T15:47:52.246ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 498.798273ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"bcca9629-d8e0-4351-a4fb-8029b18eb633","tls_certs":["a49af7a2313337b84535ddab02a38b7781b3f7789d0df44311ad2658fa92170d"]}},"default_endpoint":{"silo_id":"bcca9629-d8e0-4351-a4fb-8029b18eb633","tls_certs":["a49af7a2313337b84535ddab02a38b7781b3f7789d0df44311ad2658fa92170d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
33072025-06-04T15:47:52.247ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33082025-06-04T15:47:52.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33092025-06-04T15:47:52.249ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 501.355674ms iteration = 25 status = null
33102025-06-04T15:47:52.256ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
33112025-06-04T15:47:52.256ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
33122025-06-04T15:47:52.256ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ac4bcf10-b079-4ef1-8515-cb4e2cc4d4de", "date": "Wed, 04 Jun 2025 15:47:51 GMT"} })
33132025-06-04T15:47:52.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33142025-06-04T15:47:52.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33152025-06-04T15:47:52.258ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33162025-06-04T15:47:52.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33172025-06-04T15:47:52.261ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33182025-06-04T15:47:52.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33192025-06-04T15:47:52.264ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
33202025-06-04T15:47:52.264ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33212025-06-04T15:47:52.264ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "47a05a82-cd7d-450b-8507-6c5fa2acf376", "date": "Wed, 04 Jun 2025 15:47:51 GMT"} })
33222025-06-04T15:47:52.266ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 515.998994ms iteration = 26 status = {}
33232025-06-04T15:47:52.296ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
33242025-06-04T15:47:52.297ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "bc87dcfb-d64f-40d2-a75d-20699e91d02c", "date": "Wed, 04 Jun 2025 15:47:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
33252025-06-04T15:47:52.297ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
33262025-06-04T15:47:52.299ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "02611055-de5d-47e6-bc17-14167923abbb", "date": "Wed, 04 Jun 2025 15:47:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
33272025-06-04T15:47:52.299ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
33282025-06-04T15:47:52.301ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "55c5d71d-e4b0-41c8-9b0f-be7c158e6f98", "date": "Wed, 04 Jun 2025 15:47:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
33292025-06-04T15:47:52.301ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
33302025-06-04T15:47:52.303ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
33312025-06-04T15:47:52.303ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 555.671853ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
33322025-06-04T15:47:52.340ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
33332025-06-04T15:47:52.340ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 589.66044ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
33342025-06-04T15:47:52.343ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33352025-06-04T15:47:52.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33362025-06-04T15:47:52.345ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 8dbb977a-0cb9-4cf4-916b-4e19edd41b70, rack_id: 2302d566-cff7-41c0-b6e9-4f6ac6057661, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(aeecc71f-0b8d-4aaf-8e0e-04ee00063f7a) } rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0
33372025-06-04T15:47:52.345ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33382025-06-04T15:47:52.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33392025-06-04T15:47:52.357ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
33402025-06-04T15:47:52.357ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = aeecc71f-0b8d-4aaf-8e0e-04ee00063f7a
33412025-06-04T15:47:52.357ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
33422025-06-04T15:47:52.357ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
33432025-06-04T15:47:52.357ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33442025-06-04T15:47:52.358ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33452025-06-04T15:47:52.358ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33462025-06-04T15:47:52.358ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33472025-06-04T15:47:52.358ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
33482025-06-04T15:47:52.358ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
33492025-06-04T15:47:52.358ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
33502025-06-04T15:47:52.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33512025-06-04T15:47:52.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33522025-06-04T15:47:52.361ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0
33532025-06-04T15:47:52.361ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
33542025-06-04T15:47:52.473ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5cf9cde8-cb6c-47ed-8433-a2a6e15b9056", "date": "Wed, 04 Jun 2025 15:47:51 GMT"} })
33552025-06-04T15:47:52.473ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch = Switch0
33562025-06-04T15:47:52.473ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
33572025-06-04T15:47:52.481ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "822ec26f-0435-4691-b66d-0607bee15c96", "content-length": "682", "date": "Wed, 04 Jun 2025 15:47:51 GMT"} })
33582025-06-04T15:47:52.481ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33592025-06-04T15:47:52.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33602025-06-04T15:47:52.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33612025-06-04T15:47:52.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33622025-06-04T15:47:52.488ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33632025-06-04T15:47:52.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33642025-06-04T15:47:52.490ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33652025-06-04T15:47:52.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33662025-06-04T15:47:52.497ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 748.288241ms iteration = 25 status = {}
33672025-06-04T15:47:52.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9faddf9a-2fd2-4809-ab04-bc665009c6fd roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33682025-06-04T15:47:52.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9faddf9a-2fd2-4809-ab04-bc665009c6fd resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33692025-06-04T15:47:52.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9faddf9a-2fd2-4809-ab04-bc665009c6fd response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33702025-06-04T15:47:53.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ef9515c7-74dc-4c5b-8364-9f18af053558 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33712025-06-04T15:47:53.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ef9515c7-74dc-4c5b-8364-9f18af053558 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33722025-06-04T15:47:53.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2227 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ef9515c7-74dc-4c5b-8364-9f18af053558 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33732025-06-04T15:47:54.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 307e2019-637a-4139-9990-e598bed4a887 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33742025-06-04T15:47:54.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 307e2019-637a-4139-9990-e598bed4a887 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33752025-06-04T15:47:54.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 307e2019-637a-4139-9990-e598bed4a887 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33762025-06-04T15:47:55.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 978de7e7-4590-4211-8d99-6661086107c8 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33772025-06-04T15:47:55.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 978de7e7-4590-4211-8d99-6661086107c8 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33782025-06-04T15:47:55.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 978de7e7-4590-4211-8d99-6661086107c8 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33792025-06-04T15:47:56.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 96b7781a-1bd7-48f9-b891-f5e4cef2ef05 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33802025-06-04T15:47:56.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 96b7781a-1bd7-48f9-b891-f5e4cef2ef05 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33812025-06-04T15:47:56.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2804 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 96b7781a-1bd7-48f9-b891-f5e4cef2ef05 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33822025-06-04T15:47:57.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 491ad5ac-936e-4072-bdf4-dbbee460498b roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33832025-06-04T15:47:57.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 491ad5ac-936e-4072-bdf4-dbbee460498b resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33842025-06-04T15:47:57.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2578 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 491ad5ac-936e-4072-bdf4-dbbee460498b response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33852025-06-04T15:47:58.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9d889ba3-598d-4ba3-8986-fd108a672564 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33862025-06-04T15:47:58.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9d889ba3-598d-4ba3-8986-fd108a672564 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33872025-06-04T15:47:58.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9d889ba3-598d-4ba3-8986-fd108a672564 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33882025-06-04T15:47:59.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4a52da2b-d1b2-4620-be1f-6731d3b3e2dc roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33892025-06-04T15:47:59.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4a52da2b-d1b2-4620-be1f-6731d3b3e2dc resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33902025-06-04T15:47:59.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4a52da2b-d1b2-4620-be1f-6731d3b3e2dc response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33912025-06-04T15:47:59.951ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 473 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = 0dedc9be-6fae-4930-a684-aade5bf7c616 response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
33922025-06-04T15:48:00.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d00a7607-6e38-4d4b-bf8b-6861b9ebdb26 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33932025-06-04T15:48:00.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d00a7607-6e38-4d4b-bf8b-6861b9ebdb26 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33942025-06-04T15:48:00.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2508 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d00a7607-6e38-4d4b-bf8b-6861b9ebdb26 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
33952025-06-04T15:48:01.749ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
33962025-06-04T15:48:01.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33972025-06-04T15:48:01.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33982025-06-04T15:48:01.750ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
33992025-06-04T15:48:01.750ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34002025-06-04T15:48:01.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34012025-06-04T15:48:01.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34022025-06-04T15:48:01.781ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34032025-06-04T15:48:01.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34042025-06-04T15:48:01.782ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.669311ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34052025-06-04T15:48:01.783ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34062025-06-04T15:48:01.783ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34072025-06-04T15:48:01.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34082025-06-04T15:48:01.786ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34092025-06-04T15:48:01.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34102025-06-04T15:48:01.788ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34112025-06-04T15:48:01.790ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
34122025-06-04T15:48:01.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34132025-06-04T15:48:01.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34142025-06-04T15:48:01.801ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
34152025-06-04T15:48:01.801ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.413994ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
34162025-06-04T15:48:01.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9f862a45-c6a6-4d9f-b5dc-d739bd78978a roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34172025-06-04T15:48:01.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9f862a45-c6a6-4d9f-b5dc-d739bd78978a resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34182025-06-04T15:48:01.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1867 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9f862a45-c6a6-4d9f-b5dc-d739bd78978a response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34192025-06-04T15:48:02.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0eb4631b-7124-4580-9f52-86ecbcd6cdd5 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34202025-06-04T15:48:02.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0eb4631b-7124-4580-9f52-86ecbcd6cdd5 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34212025-06-04T15:48:02.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0eb4631b-7124-4580-9f52-86ecbcd6cdd5 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34222025-06-04T15:48:03.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2ba87e15-44a9-4a78-9147-e4f12f787fb5 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34232025-06-04T15:48:03.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2ba87e15-44a9-4a78-9147-e4f12f787fb5 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34242025-06-04T15:48:03.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2ba87e15-44a9-4a78-9147-e4f12f787fb5 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34252025-06-04T15:48:04.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f07d848b-57ec-4d18-86e6-ee89d4e35c7a roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34262025-06-04T15:48:04.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f07d848b-57ec-4d18-86e6-ee89d4e35c7a resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34272025-06-04T15:48:04.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f07d848b-57ec-4d18-86e6-ee89d4e35c7a response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34282025-06-04T15:48:05.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 61e7e4e7-9e51-4b1f-b221-f10be41ba98b roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34292025-06-04T15:48:05.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 61e7e4e7-9e51-4b1f-b221-f10be41ba98b resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34302025-06-04T15:48:05.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2304 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 61e7e4e7-9e51-4b1f-b221-f10be41ba98b response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34312025-06-04T15:48:06.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 66bb5cd2-53ca-42b8-bcd5-22a41fc68834 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34322025-06-04T15:48:06.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 66bb5cd2-53ca-42b8-bcd5-22a41fc68834 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34332025-06-04T15:48:06.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 66bb5cd2-53ca-42b8-bcd5-22a41fc68834 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34342025-06-04T15:48:07.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5811f404-e686-486d-ab11-aa87043951b6 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34352025-06-04T15:48:07.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5811f404-e686-486d-ab11-aa87043951b6 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34362025-06-04T15:48:07.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5811f404-e686-486d-ab11-aa87043951b6 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34372025-06-04T15:48:08.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b1f61728-9922-4416-8797-07d4f5d5c17d roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34382025-06-04T15:48:08.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b1f61728-9922-4416-8797-07d4f5d5c17d resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34392025-06-04T15:48:08.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2488 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b1f61728-9922-4416-8797-07d4f5d5c17d response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34402025-06-04T15:48:09.951ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 584 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = 21bb35f5-5fe5-4133-b9c6-6784f52fcec4 response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
34412025-06-04T15:48:09.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d9c74247-c0c4-423d-b205-2c0bb606413b roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34422025-06-04T15:48:09.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d9c74247-c0c4-423d-b205-2c0bb606413b resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34432025-06-04T15:48:09.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d9c74247-c0c4-423d-b205-2c0bb606413b response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34442025-06-04T15:48:11.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 33ecfa60-cb0f-4dec-82bc-f2fa64a1c98b roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34452025-06-04T15:48:11.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 33ecfa60-cb0f-4dec-82bc-f2fa64a1c98b resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34462025-06-04T15:48:11.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 33ecfa60-cb0f-4dec-82bc-f2fa64a1c98b response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34472025-06-04T15:48:11.749ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
34482025-06-04T15:48:11.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34492025-06-04T15:48:11.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34502025-06-04T15:48:11.750ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
34512025-06-04T15:48:11.750ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34522025-06-04T15:48:11.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34532025-06-04T15:48:11.751ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34542025-06-04T15:48:11.752ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34552025-06-04T15:48:11.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34562025-06-04T15:48:11.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34572025-06-04T15:48:11.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34582025-06-04T15:48:11.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34592025-06-04T15:48:11.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34602025-06-04T15:48:11.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34612025-06-04T15:48:11.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34622025-06-04T15:48:11.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
34632025-06-04T15:48:11.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34642025-06-04T15:48:11.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34652025-06-04T15:48:11.768ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
34662025-06-04T15:48:11.768ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.927343ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
34672025-06-04T15:48:11.791ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 41.270717ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34682025-06-04T15:48:12.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3545d585-677a-4496-bf9f-f0b06bef7dcc roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34692025-06-04T15:48:12.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3545d585-677a-4496-bf9f-f0b06bef7dcc resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34702025-06-04T15:48:12.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3545d585-677a-4496-bf9f-f0b06bef7dcc response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34712025-06-04T15:48:13.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 194f3847-d87a-42cc-852d-70a874594a75 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34722025-06-04T15:48:13.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 194f3847-d87a-42cc-852d-70a874594a75 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34732025-06-04T15:48:13.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 194f3847-d87a-42cc-852d-70a874594a75 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34742025-06-04T15:48:14.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 71bdeb69-273d-4d10-bd32-b592336700ce roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34752025-06-04T15:48:14.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 71bdeb69-273d-4d10-bd32-b592336700ce resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34762025-06-04T15:48:14.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2483 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 71bdeb69-273d-4d10-bd32-b592336700ce response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34772025-06-04T15:48:15.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f68ddd74-5a4f-47c2-85ad-6e357620eb7f roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34782025-06-04T15:48:15.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f68ddd74-5a4f-47c2-85ad-6e357620eb7f resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34792025-06-04T15:48:15.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2670 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f68ddd74-5a4f-47c2-85ad-6e357620eb7f response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34802025-06-04T15:48:16.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 344b915e-5668-4275-b185-c918072f3c9a roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34812025-06-04T15:48:16.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 344b915e-5668-4275-b185-c918072f3c9a resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34822025-06-04T15:48:16.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2556 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 344b915e-5668-4275-b185-c918072f3c9a response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34832025-06-04T15:48:17.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = caacda9f-7311-423a-8664-15a15edad933 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34842025-06-04T15:48:17.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = caacda9f-7311-423a-8664-15a15edad933 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34852025-06-04T15:48:17.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1987 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = caacda9f-7311-423a-8664-15a15edad933 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34862025-06-04T15:48:18.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3df429af-7d64-40cc-8e02-8c46449ea849 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34872025-06-04T15:48:18.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3df429af-7d64-40cc-8e02-8c46449ea849 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34882025-06-04T15:48:18.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3df429af-7d64-40cc-8e02-8c46449ea849 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34892025-06-04T15:48:19.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a01274e1-1325-45b0-974f-bed83de12519 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34902025-06-04T15:48:19.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a01274e1-1325-45b0-974f-bed83de12519 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34912025-06-04T15:48:19.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2486 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a01274e1-1325-45b0-974f-bed83de12519 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34922025-06-04T15:48:19.951ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 502 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = 73a05bc7-21ca-40e9-8470-be6a7645ffb8 response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
34932025-06-04T15:48:20.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d4e77f79-6171-4c8a-832e-d014fc4e40d3 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34942025-06-04T15:48:20.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d4e77f79-6171-4c8a-832e-d014fc4e40d3 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34952025-06-04T15:48:20.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d4e77f79-6171-4c8a-832e-d014fc4e40d3 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34962025-06-04T15:48:21.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a1f1336b-4ca8-4d73-9cc3-8466a08f39e9 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34972025-06-04T15:48:21.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a1f1336b-4ca8-4d73-9cc3-8466a08f39e9 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34982025-06-04T15:48:21.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2751 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a1f1336b-4ca8-4d73-9cc3-8466a08f39e9 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
34992025-06-04T15:48:21.748ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
35002025-06-04T15:48:21.748ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35012025-06-04T15:48:21.748ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
35022025-06-04T15:48:21.748ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
35032025-06-04T15:48:21.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35042025-06-04T15:48:21.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
35052025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
35062025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
35072025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
35082025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35092025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35102025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
35112025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Timeout
35122025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35132025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
35142025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
35152025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35162025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
35172025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35182025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
35192025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
35202025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35212025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
35222025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35232025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
35242025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35252025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35262025-06-04T15:48:21.750ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
35272025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
35282025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35292025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35302025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
35312025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35322025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35332025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
35342025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35352025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35362025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35372025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35382025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35392025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35402025-06-04T15:48:21.750ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2069, tv_nsec: 890697464 } })
35412025-06-04T15:48:21.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35422025-06-04T15:48:21.751ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
35432025-06-04T15:48:21.751ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2069, tv_nsec: 891505494 } })
35442025-06-04T15:48:21.752ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
35452025-06-04T15:48:21.752ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35462025-06-04T15:48:21.753ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.861886ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
35472025-06-04T15:48:21.753ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35482025-06-04T15:48:21.753ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35492025-06-04T15:48:21.753ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35502025-06-04T15:48:21.754ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35512025-06-04T15:48:21.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
35522025-06-04T15:48:21.756ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35532025-06-04T15:48:21.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35542025-06-04T15:48:21.757ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35552025-06-04T15:48:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
35562025-06-04T15:48:21.758ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
35572025-06-04T15:48:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
35582025-06-04T15:48:21.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35592025-06-04T15:48:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
35602025-06-04T15:48:21.758ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35612025-06-04T15:48:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
35622025-06-04T15:48:21.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
35632025-06-04T15:48:21.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
35642025-06-04T15:48:21.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
35652025-06-04T15:48:21.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35662025-06-04T15:48:21.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
35672025-06-04T15:48:21.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
35682025-06-04T15:48:21.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
35692025-06-04T15:48:21.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35702025-06-04T15:48:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35712025-06-04T15:48:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35722025-06-04T15:48:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35732025-06-04T15:48:21.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35742025-06-04T15:48:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35752025-06-04T15:48:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
35762025-06-04T15:48:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
35772025-06-04T15:48:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35782025-06-04T15:48:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35792025-06-04T15:48:21.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
35802025-06-04T15:48:21.760ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35812025-06-04T15:48:21.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35822025-06-04T15:48:21.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35832025-06-04T15:48:21.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35842025-06-04T15:48:21.761ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35852025-06-04T15:48:21.761ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
35862025-06-04T15:48:21.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35872025-06-04T15:48:21.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35882025-06-04T15:48:21.761ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35892025-06-04T15:48:21.762ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 26 reason = Timeout
35902025-06-04T15:48:21.762ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
35912025-06-04T15:48:21.762ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35922025-06-04T15:48:21.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
35932025-06-04T15:48:21.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35942025-06-04T15:48:21.763ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35952025-06-04T15:48:21.763ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35962025-06-04T15:48:21.763ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35972025-06-04T15:48:21.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35982025-06-04T15:48:21.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35992025-06-04T15:48:21.764ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2069, tv_nsec: 904137899 } })
36002025-06-04T15:48:21.764ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
36012025-06-04T15:48:21.766ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.749545ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
36022025-06-04T15:48:21.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36032025-06-04T15:48:21.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36042025-06-04T15:48:21.768ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36052025-06-04T15:48:21.768ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36062025-06-04T15:48:21.768ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36072025-06-04T15:48:21.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36082025-06-04T15:48:21.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36092025-06-04T15:48:21.777ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
36102025-06-04T15:48:21.777ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36112025-06-04T15:48:21.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36122025-06-04T15:48:21.796ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
36132025-06-04T15:48:21.796ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.411421ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
36142025-06-04T15:48:21.798ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
36152025-06-04T15:48:21.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
36162025-06-04T15:48:21.801ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36172025-06-04T15:48:21.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36182025-06-04T15:48:21.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36192025-06-04T15:48:21.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36202025-06-04T15:48:21.806ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36212025-06-04T15:48:21.808ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36222025-06-04T15:48:21.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36232025-06-04T15:48:21.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e751cd2d-7b1b-4ea0-8b5a-62525772a5f5, lookup_type: ById(e751cd2d-7b1b-4ea0-8b5a-62525772a5f5) } result = Ok(())
36242025-06-04T15:48:21.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36252025-06-04T15:48:21.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36262025-06-04T15:48:21.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36272025-06-04T15:48:21.810ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36282025-06-04T15:48:21.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36292025-06-04T15:48:21.810ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.512536ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
36302025-06-04T15:48:21.811ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 61.284243ms iteration = 26 status = 0
36312025-06-04T15:48:21.812ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36322025-06-04T15:48:21.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36332025-06-04T15:48:21.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36342025-06-04T15:48:21.815ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36352025-06-04T15:48:21.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36362025-06-04T15:48:21.819ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36372025-06-04T15:48:21.819ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
36382025-06-04T15:48:21.819ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 69.483234ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
36392025-06-04T15:48:21.821ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.137795ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36402025-06-04T15:48:21.822ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36412025-06-04T15:48:21.822ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 60.355352ms iteration = 26 status = {"errors":[],"requests_created_ok":[]}
36422025-06-04T15:48:21.823ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
36432025-06-04T15:48:21.823ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.527972ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
36442025-06-04T15:48:21.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36452025-06-04T15:48:21.826ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36462025-06-04T15:48:21.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36472025-06-04T15:48:21.832ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36482025-06-04T15:48:21.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36492025-06-04T15:48:21.844ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36502025-06-04T15:48:21.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
36512025-06-04T15:48:21.846ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
36522025-06-04T15:48:21.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
36532025-06-04T15:48:21.849ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
36542025-06-04T15:48:21.849ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36552025-06-04T15:48:21.850ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "29c8ca85-2d43-462d-831e-c0b6a6f1aff5", "content-length": "26", "date": "Wed, 04 Jun 2025 15:48:21 GMT"} })
36562025-06-04T15:48:21.850ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36572025-06-04T15:48:21.851ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36582025-06-04T15:48:21.852ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
36592025-06-04T15:48:21.852ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36602025-06-04T15:48:21.852ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0812d4b6-1b30-4710-b21f-7d72c464f233", "content-length": "26", "date": "Wed, 04 Jun 2025 15:48:21 GMT"} })
36612025-06-04T15:48:21.852ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36622025-06-04T15:48:21.854ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36632025-06-04T15:48:21.859ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 100.87304ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
36642025-06-04T15:48:21.862ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 111.740633ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36652025-06-04T15:48:21.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 120.536072ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
36662025-06-04T15:48:21.879ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 zone_address = fd00:1122:3344:101::2
36672025-06-04T15:48:21.879ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36682025-06-04T15:48:21.879ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "433762c5-43cf-4b87-88cf-10bfa6836c76", "content-length": "26", "date": "Wed, 04 Jun 2025 15:48:21 GMT"} })
36692025-06-04T15:48:21.879ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36702025-06-04T15:48:21.880ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
36712025-06-04T15:48:21.908ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36722025-06-04T15:48:21.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36732025-06-04T15:48:21.926ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
36742025-06-04T15:48:21.927ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36752025-06-04T15:48:21.927ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "555073eb-2b54-4a18-8117-1cdcd4184b13", "content-length": "372", "date": "Wed, 04 Jun 2025 15:48:21 GMT"} })
36762025-06-04T15:48:21.927ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36772025-06-04T15:48:21.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36782025-06-04T15:48:21.942ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 192.111612ms iteration = 29 status = {"physical_disks_added":0}
36792025-06-04T15:48:21.955ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 207.079106ms iteration = 26 status = {}
36802025-06-04T15:48:21.961ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
36812025-06-04T15:48:21.961ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 211.281998ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
36822025-06-04T15:48:21.963ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36832025-06-04T15:48:21.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36842025-06-04T15:48:21.965ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 217.230971ms iteration = 26 status = null
36852025-06-04T15:48:21.973ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
36862025-06-04T15:48:21.973ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
36872025-06-04T15:48:21.973ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "55be6c87-f664-4214-80a5-0c87375dc4af", "date": "Wed, 04 Jun 2025 15:48:21 GMT"} })
36882025-06-04T15:48:21.973ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36892025-06-04T15:48:21.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36902025-06-04T15:48:21.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36912025-06-04T15:48:21.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36922025-06-04T15:48:21.978ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36932025-06-04T15:48:21.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36942025-06-04T15:48:21.981ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
36952025-06-04T15:48:21.981ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36962025-06-04T15:48:21.981ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "07ebdb80-1e6f-48cb-8e30-dc1696c7c842", "date": "Wed, 04 Jun 2025 15:48:21 GMT"} })
36972025-06-04T15:48:21.984ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 233.594183ms iteration = 27 status = {}
36982025-06-04T15:48:22.026ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36992025-06-04T15:48:22.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37002025-06-04T15:48:22.028ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 8dbb977a-0cb9-4cf4-916b-4e19edd41b70, rack_id: 2302d566-cff7-41c0-b6e9-4f6ac6057661, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(aeecc71f-0b8d-4aaf-8e0e-04ee00063f7a) } rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0
37012025-06-04T15:48:22.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37022025-06-04T15:48:22.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37032025-06-04T15:48:22.037ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37042025-06-04T15:48:22.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37052025-06-04T15:48:22.038ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
37062025-06-04T15:48:22.038ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = aeecc71f-0b8d-4aaf-8e0e-04ee00063f7a
37072025-06-04T15:48:22.038ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
37082025-06-04T15:48:22.038ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37092025-06-04T15:48:22.038ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37102025-06-04T15:48:22.038ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37112025-06-04T15:48:22.038ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37122025-06-04T15:48:22.038ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37132025-06-04T15:48:22.039ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37142025-06-04T15:48:22.039ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37152025-06-04T15:48:22.039ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
37162025-06-04T15:48:22.039ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37172025-06-04T15:48:22.039ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37182025-06-04T15:48:22.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37192025-06-04T15:48:22.041ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37202025-06-04T15:48:22.041ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37212025-06-04T15:48:22.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37222025-06-04T15:48:22.041ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0
37232025-06-04T15:48:22.041ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37242025-06-04T15:48:22.043ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37252025-06-04T15:48:22.045ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37262025-06-04T15:48:22.045ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37272025-06-04T15:48:22.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37282025-06-04T15:48:22.078ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37292025-06-04T15:48:22.155ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f347f21a-adfb-4015-bbc4-c6276c2b7b63", "date": "Wed, 04 Jun 2025 15:48:21 GMT"} })
37302025-06-04T15:48:22.155ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch = Switch0
37312025-06-04T15:48:22.155ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37322025-06-04T15:48:22.155ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f1a200a-5ffd-4588-87a4-c8b232f18199", "content-length": "691", "date": "Wed, 04 Jun 2025 15:48:21 GMT"} })
37332025-06-04T15:48:22.155ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
37342025-06-04T15:48:22.155ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
37352025-06-04T15:48:22.155ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
37362025-06-04T15:48:22.155ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b81f9617-ca89-4a7f-a27e-4c9122321414", "content-length": "682", "date": "Wed, 04 Jun 2025 15:48:21 GMT"} })
37372025-06-04T15:48:22.156ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37382025-06-04T15:48:22.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37392025-06-04T15:48:22.158ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 407.589592ms iteration = 27 status = {}
37402025-06-04T15:48:22.160ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37412025-06-04T15:48:22.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37422025-06-04T15:48:22.163ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37432025-06-04T15:48:22.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37442025-06-04T15:48:22.165ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37452025-06-04T15:48:22.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37462025-06-04T15:48:22.172ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 422.040409ms iteration = 26 status = {}
37472025-06-04T15:48:22.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 484748a5-113c-4832-b9ee-c888c781f6f7 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37482025-06-04T15:48:22.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 484748a5-113c-4832-b9ee-c888c781f6f7 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37492025-06-04T15:48:22.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1733 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 484748a5-113c-4832-b9ee-c888c781f6f7 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37502025-06-04T15:48:23.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 21abd646-a216-40c7-bd3e-e03ccd523735 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37512025-06-04T15:48:23.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 21abd646-a216-40c7-bd3e-e03ccd523735 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37522025-06-04T15:48:23.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 21abd646-a216-40c7-bd3e-e03ccd523735 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37532025-06-04T15:48:24.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = dc6eb009-4a33-48e5-be67-68ed34c6260c roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37542025-06-04T15:48:24.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = dc6eb009-4a33-48e5-be67-68ed34c6260c resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37552025-06-04T15:48:24.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = dc6eb009-4a33-48e5-be67-68ed34c6260c response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37562025-06-04T15:48:25.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 11637ad3-c303-4e1d-85b9-d9f6e3be2eec roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37572025-06-04T15:48:25.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 11637ad3-c303-4e1d-85b9-d9f6e3be2eec resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37582025-06-04T15:48:25.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 11637ad3-c303-4e1d-85b9-d9f6e3be2eec response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37592025-06-04T15:48:26.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = fd9557ef-ad97-4cea-96ec-d56753785a75 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37602025-06-04T15:48:26.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = fd9557ef-ad97-4cea-96ec-d56753785a75 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37612025-06-04T15:48:26.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2641 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = fd9557ef-ad97-4cea-96ec-d56753785a75 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37622025-06-04T15:48:27.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b76a1a0e-426d-44fa-8355-fc21ed7d3f02 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37632025-06-04T15:48:27.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b76a1a0e-426d-44fa-8355-fc21ed7d3f02 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37642025-06-04T15:48:27.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b76a1a0e-426d-44fa-8355-fc21ed7d3f02 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37652025-06-04T15:48:28.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 023094a1-ac9b-450c-b543-8510882802a5 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37662025-06-04T15:48:28.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 023094a1-ac9b-450c-b543-8510882802a5 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37672025-06-04T15:48:28.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 023094a1-ac9b-450c-b543-8510882802a5 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37682025-06-04T15:48:29.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5080d3b1-3006-430a-9903-99b3c1efce37 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37692025-06-04T15:48:29.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5080d3b1-3006-430a-9903-99b3c1efce37 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37702025-06-04T15:48:29.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5080d3b1-3006-430a-9903-99b3c1efce37 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37712025-06-04T15:48:29.941ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:35891
37722025-06-04T15:48:29.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35891 req_id = 6d8b1529-eaa6-40ad-b104-ccc29dba2d0b roles = RoleSet { roles: {} } uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?sort_by=id_ascending
37732025-06-04T15:48:29.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35891 req_id = 6d8b1529-eaa6-40ad-b104-ccc29dba2d0b resource = Database result = Ok(()) uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?sort_by=id_ascending
37742025-06-04T15:48:29.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35891 req_id = 6d8b1529-eaa6-40ad-b104-ccc29dba2d0b response_code = 200 uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?sort_by=id_ascending
37752025-06-04T15:48:29.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35891 req_id = 8db95a7c-b4ba-41e8-9a8f-718b99e68e10 roles = RoleSet { roles: {} } uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzUxY2QyZC03YjFiLTRlYTAtOGI1YS02MjUyNTc3MmE1ZjUifX0%3D
37762025-06-04T15:48:29.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35891 req_id = 8db95a7c-b4ba-41e8-9a8f-718b99e68e10 resource = Database result = Ok(()) uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzUxY2QyZC03YjFiLTRlYTAtOGI1YS02MjUyNTc3MmE1ZjUifX0%3D
37772025-06-04T15:48:29.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35891 req_id = 8db95a7c-b4ba-41e8-9a8f-718b99e68e10 response_code = 200 uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzUxY2QyZC03YjFiLTRlYTAtOGI1YS02MjUyNTc3MmE1ZjUifX0%3D
37782025-06-04T15:48:29.951ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 498 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = 9b6800d4-b822-4f2b-a8cc-7ce78779792a response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
37792025-06-04T15:48:30.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e9fc2576-9707-4d65-8059-f81a00428aff roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37802025-06-04T15:48:30.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e9fc2576-9707-4d65-8059-f81a00428aff resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37812025-06-04T15:48:30.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2628 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e9fc2576-9707-4d65-8059-f81a00428aff response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37822025-06-04T15:48:31.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7401d300-36e7-47de-9eee-ff6be6f3f798 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37832025-06-04T15:48:31.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7401d300-36e7-47de-9eee-ff6be6f3f798 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37842025-06-04T15:48:31.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7401d300-36e7-47de-9eee-ff6be6f3f798 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
37852025-06-04T15:48:31.749ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
37862025-06-04T15:48:31.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37872025-06-04T15:48:31.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37882025-06-04T15:48:31.750ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
37892025-06-04T15:48:31.750ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37902025-06-04T15:48:31.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37912025-06-04T15:48:31.751ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37922025-06-04T15:48:31.752ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37932025-06-04T15:48:31.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37942025-06-04T15:48:31.754ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.388231ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37952025-06-04T15:48:31.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37962025-06-04T15:48:31.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37972025-06-04T15:48:31.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37982025-06-04T15:48:31.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37992025-06-04T15:48:31.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38002025-06-04T15:48:31.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38012025-06-04T15:48:31.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
38022025-06-04T15:48:31.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38032025-06-04T15:48:31.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38042025-06-04T15:48:31.769ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
38052025-06-04T15:48:31.769ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.573821ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
38062025-06-04T15:48:32.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2aa5d78e-062c-4d50-9203-4ed64f9ecfb6 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38072025-06-04T15:48:32.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2aa5d78e-062c-4d50-9203-4ed64f9ecfb6 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38082025-06-04T15:48:32.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2aa5d78e-062c-4d50-9203-4ed64f9ecfb6 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38092025-06-04T15:48:33.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = fca1e8de-81b9-45af-8f0a-2c41b7d71308 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38102025-06-04T15:48:33.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = fca1e8de-81b9-45af-8f0a-2c41b7d71308 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38112025-06-04T15:48:33.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = fca1e8de-81b9-45af-8f0a-2c41b7d71308 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38122025-06-04T15:48:34.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0b509307-088e-419c-b305-eec0b06a0c80 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38132025-06-04T15:48:34.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0b509307-088e-419c-b305-eec0b06a0c80 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38142025-06-04T15:48:34.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0b509307-088e-419c-b305-eec0b06a0c80 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38152025-06-04T15:48:35.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = eb9b6f8f-69fe-4a61-a7b2-53432157e8cf roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38162025-06-04T15:48:35.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = eb9b6f8f-69fe-4a61-a7b2-53432157e8cf resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38172025-06-04T15:48:35.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2841 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = eb9b6f8f-69fe-4a61-a7b2-53432157e8cf response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38182025-06-04T15:48:36.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bb767a13-a966-4090-81ba-870cdb00c859 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38192025-06-04T15:48:36.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bb767a13-a966-4090-81ba-870cdb00c859 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38202025-06-04T15:48:36.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2439 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bb767a13-a966-4090-81ba-870cdb00c859 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38212025-06-04T15:48:37.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f0bc3b3f-4f12-45d7-9101-338884dc7e51 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38222025-06-04T15:48:37.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f0bc3b3f-4f12-45d7-9101-338884dc7e51 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38232025-06-04T15:48:37.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f0bc3b3f-4f12-45d7-9101-338884dc7e51 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38242025-06-04T15:48:38.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bcb5ed2a-3c87-4f85-b012-87229d379e15 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38252025-06-04T15:48:38.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bcb5ed2a-3c87-4f85-b012-87229d379e15 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38262025-06-04T15:48:38.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1857 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bcb5ed2a-3c87-4f85-b012-87229d379e15 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38272025-06-04T15:48:39.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = da048e13-2de0-43b3-8575-3a82d9a756a7 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38282025-06-04T15:48:39.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = da048e13-2de0-43b3-8575-3a82d9a756a7 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38292025-06-04T15:48:39.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2411 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = da048e13-2de0-43b3-8575-3a82d9a756a7 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38302025-06-04T15:48:39.951ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 551 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = e125ce19-08b7-4432-9a0f-5eb703c78892 response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
38312025-06-04T15:48:40.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ff5363c2-9fc7-4007-9c17-edecad85c769 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38322025-06-04T15:48:40.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ff5363c2-9fc7-4007-9c17-edecad85c769 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38332025-06-04T15:48:40.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2607 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ff5363c2-9fc7-4007-9c17-edecad85c769 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38342025-06-04T15:48:41.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7363251e-6956-4352-89d5-f92907d8dd37 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38352025-06-04T15:48:41.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7363251e-6956-4352-89d5-f92907d8dd37 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38362025-06-04T15:48:41.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7363251e-6956-4352-89d5-f92907d8dd37 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38372025-06-04T15:48:41.750ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
38382025-06-04T15:48:41.750ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38392025-06-04T15:48:41.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38402025-06-04T15:48:41.750ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
38412025-06-04T15:48:41.750ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38422025-06-04T15:48:41.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38432025-06-04T15:48:41.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38442025-06-04T15:48:41.752ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38452025-06-04T15:48:41.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38462025-06-04T15:48:41.754ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.851028ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38472025-06-04T15:48:41.755ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38482025-06-04T15:48:41.755ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38492025-06-04T15:48:41.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38502025-06-04T15:48:41.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38512025-06-04T15:48:41.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38522025-06-04T15:48:41.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38532025-06-04T15:48:41.761ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
38542025-06-04T15:48:41.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38552025-06-04T15:48:41.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38562025-06-04T15:48:41.770ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
38572025-06-04T15:48:41.770ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.715733ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
38582025-06-04T15:48:42.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2046fedb-90eb-4f0a-b8a3-b1ec16b339f4 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38592025-06-04T15:48:42.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2046fedb-90eb-4f0a-b8a3-b1ec16b339f4 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38602025-06-04T15:48:42.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1882 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2046fedb-90eb-4f0a-b8a3-b1ec16b339f4 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38612025-06-04T15:48:43.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ec0bf2e9-7b02-4f34-ab5a-c78416e62fd7 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38622025-06-04T15:48:43.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ec0bf2e9-7b02-4f34-ab5a-c78416e62fd7 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38632025-06-04T15:48:43.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ec0bf2e9-7b02-4f34-ab5a-c78416e62fd7 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38642025-06-04T15:48:44.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0e54f443-b24f-48a9-a3cb-7ddd829f2661 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38652025-06-04T15:48:44.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0e54f443-b24f-48a9-a3cb-7ddd829f2661 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38662025-06-04T15:48:44.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2295 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0e54f443-b24f-48a9-a3cb-7ddd829f2661 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38672025-06-04T15:48:45.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e10308ff-f420-441a-b973-4ab1597473fe roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38682025-06-04T15:48:45.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e10308ff-f420-441a-b973-4ab1597473fe resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38692025-06-04T15:48:45.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2749 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e10308ff-f420-441a-b973-4ab1597473fe response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38702025-06-04T15:48:46.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2f42f392-efcb-48ec-bb34-92cc74070561 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38712025-06-04T15:48:46.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2f42f392-efcb-48ec-bb34-92cc74070561 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38722025-06-04T15:48:46.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2740 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2f42f392-efcb-48ec-bb34-92cc74070561 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38732025-06-04T15:48:47.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 66cafddd-e472-44e0-9705-8f55d33d95e1 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38742025-06-04T15:48:47.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 66cafddd-e472-44e0-9705-8f55d33d95e1 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38752025-06-04T15:48:47.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 66cafddd-e472-44e0-9705-8f55d33d95e1 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38762025-06-04T15:48:48.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3ba4002b-2f5f-480d-abce-f1e55a334389 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38772025-06-04T15:48:48.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3ba4002b-2f5f-480d-abce-f1e55a334389 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38782025-06-04T15:48:48.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 7297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3ba4002b-2f5f-480d-abce-f1e55a334389 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38792025-06-04T15:48:49.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7bdf4a6a-cbaa-4b76-adec-be650fdce243 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38802025-06-04T15:48:49.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7bdf4a6a-cbaa-4b76-adec-be650fdce243 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38812025-06-04T15:48:49.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2480 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7bdf4a6a-cbaa-4b76-adec-be650fdce243 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38822025-06-04T15:48:49.951ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 497 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = 71b70816-dd50-47ab-a402-43a19a5cdb83 response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
38832025-06-04T15:48:50.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2c49f1ad-85cf-4ac8-87cc-a54b52fc0584 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38842025-06-04T15:48:50.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2c49f1ad-85cf-4ac8-87cc-a54b52fc0584 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38852025-06-04T15:48:50.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2c49f1ad-85cf-4ac8-87cc-a54b52fc0584 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38862025-06-04T15:48:51.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9bf58ad4-d5a4-45c6-889b-43a32a0dfef0 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38872025-06-04T15:48:51.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9bf58ad4-d5a4-45c6-889b-43a32a0dfef0 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38882025-06-04T15:48:51.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9bf58ad4-d5a4-45c6-889b-43a32a0dfef0 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
38892025-06-04T15:48:51.748ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
38902025-06-04T15:48:51.748ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
38912025-06-04T15:48:51.748ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
38922025-06-04T15:48:51.748ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38932025-06-04T15:48:51.748ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38942025-06-04T15:48:51.748ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
38952025-06-04T15:48:51.748ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
38962025-06-04T15:48:51.748ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
38972025-06-04T15:48:51.748ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-04 15:38:51.748467991 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
38982025-06-04T15:48:51.748ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
38992025-06-04T15:48:51.748ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
39002025-06-04T15:48:51.748ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
39012025-06-04T15:48:51.748ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39022025-06-04T15:48:51.748ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
39032025-06-04T15:48:51.748ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
39042025-06-04T15:48:51.748ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39052025-06-04T15:48:51.748ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
39062025-06-04T15:48:51.748ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
39072025-06-04T15:48:51.748ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39082025-06-04T15:48:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39092025-06-04T15:48:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39102025-06-04T15:48:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39112025-06-04T15:48:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
39122025-06-04T15:48:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39132025-06-04T15:48:51.748ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d97642c-17fd-4803-bc28-7ad83219ce8c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("91bdae66-8e10-4892-9bfd-517dee32a9bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e10264ea-c7fb-4742-9452-fa5e125ebf3d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e10264ea-c7fb-4742-9452-fa5e125ebf3d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2099, tv_nsec: 888189973 } })
39142025-06-04T15:48:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39152025-06-04T15:48:51.749ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("74458287-879a-4471-829f-da352f40aff2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("84104d89-910f-45b9-adb6-d23a6d4f41d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("84104d89-910f-45b9-adb6-d23a6d4f41d6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2099, tv_nsec: 888270814 } })
39162025-06-04T15:48:51.749ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39172025-06-04T15:48:51.749ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
39182025-06-04T15:48:51.749ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 869.441\u{b5}s iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
39192025-06-04T15:48:51.749ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
39202025-06-04T15:48:51.749ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.047663ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
39212025-06-04T15:48:51.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39222025-06-04T15:48:51.749ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
39232025-06-04T15:48:51.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39242025-06-04T15:48:51.749ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
39252025-06-04T15:48:51.749ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39262025-06-04T15:48:51.749ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
39272025-06-04T15:48:51.749ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
39282025-06-04T15:48:51.749ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
39292025-06-04T15:48:51.749ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39302025-06-04T15:48:51.749ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
39312025-06-04T15:48:51.749ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 27 reason = Timeout
39322025-06-04T15:48:51.749ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf
39332025-06-04T15:48:51.749ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
39342025-06-04T15:48:51.749ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.49\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf"}
39352025-06-04T15:48:51.749ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
39362025-06-04T15:48:51.750ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39372025-06-04T15:48:51.750ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
39382025-06-04T15:48:51.750ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39392025-06-04T15:48:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39402025-06-04T15:48:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39412025-06-04T15:48:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
39422025-06-04T15:48:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39432025-06-04T15:48:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39442025-06-04T15:48:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
39452025-06-04T15:48:51.751ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
39462025-06-04T15:48:51.751ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
39472025-06-04T15:48:51.751ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39482025-06-04T15:48:51.751ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39492025-06-04T15:48:51.751ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
39502025-06-04T15:48:51.751ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
39512025-06-04T15:48:51.751ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
39522025-06-04T15:48:51.751ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
39532025-06-04T15:48:51.751ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
39542025-06-04T15:48:51.751ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
39552025-06-04T15:48:51.751ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39562025-06-04T15:48:51.751ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39572025-06-04T15:48:51.751ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39582025-06-04T15:48:51.751ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39592025-06-04T15:48:51.751ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
39602025-06-04T15:48:51.751ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39612025-06-04T15:48:51.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39622025-06-04T15:48:51.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39632025-06-04T15:48:51.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39642025-06-04T15:48:51.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39652025-06-04T15:48:51.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
39662025-06-04T15:48:51.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39672025-06-04T15:48:51.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39682025-06-04T15:48:51.751ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2099, tv_nsec: 890824805 } })
39692025-06-04T15:48:51.751ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39702025-06-04T15:48:51.751ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
39712025-06-04T15:48:51.751ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39722025-06-04T15:48:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39732025-06-04T15:48:51.752ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-04 15:38:51.748467991 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
39742025-06-04T15:48:51.752ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.196382ms iteration = 14 status = {"expiration":"2025-06-04T15:38:51.748467991Z","pruned":[]}
39752025-06-04T15:48:51.752ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2099, tv_nsec: 892075001 } })
39762025-06-04T15:48:51.753ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
39772025-06-04T15:48:51.753ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39782025-06-04T15:48:51.754ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
39792025-06-04T15:48:51.754ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39802025-06-04T15:48:51.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39812025-06-04T15:48:51.756ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39822025-06-04T15:48:51.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
39832025-06-04T15:48:51.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39842025-06-04T15:48:51.757ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.998229ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39852025-06-04T15:48:51.758ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39862025-06-04T15:48:51.758ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39872025-06-04T15:48:51.758ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
39882025-06-04T15:48:51.758ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
39892025-06-04T15:48:51.758ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
39902025-06-04T15:48:51.758ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39912025-06-04T15:48:51.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39922025-06-04T15:48:51.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
39932025-06-04T15:48:51.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39942025-06-04T15:48:51.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
39952025-06-04T15:48:51.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39962025-06-04T15:48:51.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
39972025-06-04T15:48:51.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39982025-06-04T15:48:51.758ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
39992025-06-04T15:48:51.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
40002025-06-04T15:48:51.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40012025-06-04T15:48:51.758ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
40022025-06-04T15:48:51.758ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
40032025-06-04T15:48:51.759ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
40042025-06-04T15:48:51.759ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
40052025-06-04T15:48:51.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
40062025-06-04T15:48:51.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40072025-06-04T15:48:51.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
40082025-06-04T15:48:51.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
40092025-06-04T15:48:51.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40102025-06-04T15:48:51.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
40112025-06-04T15:48:51.761ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40122025-06-04T15:48:51.761ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40132025-06-04T15:48:51.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40142025-06-04T15:48:51.761ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
40152025-06-04T15:48:51.761ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40162025-06-04T15:48:51.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40172025-06-04T15:48:51.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40182025-06-04T15:48:51.762ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40192025-06-04T15:48:51.762ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40202025-06-04T15:48:51.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40212025-06-04T15:48:51.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40222025-06-04T15:48:51.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40232025-06-04T15:48:51.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40242025-06-04T15:48:51.762ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 27 reason = Timeout
40252025-06-04T15:48:51.762ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 14 reason = Timeout
40262025-06-04T15:48:51.762ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
40272025-06-04T15:48:51.763ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
40282025-06-04T15:48:51.763ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 14 reason = Timeout
40292025-06-04T15:48:51.763ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
40302025-06-04T15:48:51.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
40312025-06-04T15:48:51.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
40322025-06-04T15:48:51.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
40332025-06-04T15:48:51.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40342025-06-04T15:48:51.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40352025-06-04T15:48:51.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40362025-06-04T15:48:51.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
40372025-06-04T15:48:51.764ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
40382025-06-04T15:48:51.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
40392025-06-04T15:48:51.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40402025-06-04T15:48:51.765ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40412025-06-04T15:48:51.768ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40422025-06-04T15:48:51.768ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40432025-06-04T15:48:51.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40442025-06-04T15:48:51.768ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40452025-06-04T15:48:51.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40462025-06-04T15:48:51.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40472025-06-04T15:48:51.770ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40482025-06-04T15:48:51.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40492025-06-04T15:48:51.770ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40502025-06-04T15:48:51.770ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40512025-06-04T15:48:51.771ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40522025-06-04T15:48:51.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40532025-06-04T15:48:51.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40542025-06-04T15:48:51.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
40552025-06-04T15:48:51.774ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40562025-06-04T15:48:51.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40572025-06-04T15:48:51.775ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 16.998009ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
40582025-06-04T15:48:51.776ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 17.501805ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
40592025-06-04T15:48:51.778ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.096915ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
40602025-06-04T15:48:51.778ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40612025-06-04T15:48:51.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40622025-06-04T15:48:51.779ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40632025-06-04T15:48:51.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40642025-06-04T15:48:51.780ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
40652025-06-04T15:48:51.780ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 17.09842ms iteration = 14 status = {"by_rx":{},"error":null}
40662025-06-04T15:48:51.780ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2099, tv_nsec: 919419597 } })
40672025-06-04T15:48:51.780ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
40682025-06-04T15:48:51.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40692025-06-04T15:48:51.782ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40702025-06-04T15:48:51.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40712025-06-04T15:48:51.783ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.741562ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40722025-06-04T15:48:51.785ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40732025-06-04T15:48:51.786ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40742025-06-04T15:48:51.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40752025-06-04T15:48:51.789ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40762025-06-04T15:48:51.789ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
40772025-06-04T15:48:51.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
40782025-06-04T15:48:51.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40792025-06-04T15:48:51.793ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40802025-06-04T15:48:51.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40812025-06-04T15:48:51.802ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 39.410504ms iteration = 14 status = {"dispatched":[],"errors":[],"glob_version":"147.0.0","globs_reprocessed":{},"no_receivers":[]}
40822025-06-04T15:48:51.819ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40832025-06-04T15:48:51.819ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
40842025-06-04T15:48:51.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40852025-06-04T15:48:51.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40862025-06-04T15:48:51.823ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
40872025-06-04T15:48:51.823ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
40882025-06-04T15:48:51.823ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 64.942919ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
40892025-06-04T15:48:51.825ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40902025-06-04T15:48:51.825ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40912025-06-04T15:48:51.825ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40922025-06-04T15:48:51.825ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40932025-06-04T15:48:51.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40942025-06-04T15:48:51.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40952025-06-04T15:48:51.829ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40962025-06-04T15:48:51.830ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
40972025-06-04T15:48:51.830ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
40982025-06-04T15:48:51.830ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
40992025-06-04T15:48:51.830ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41002025-06-04T15:48:51.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41012025-06-04T15:48:51.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41022025-06-04T15:48:51.832ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 73.460883ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
41032025-06-04T15:48:51.832ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41042025-06-04T15:48:51.837ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41052025-06-04T15:48:51.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41062025-06-04T15:48:51.837ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41072025-06-04T15:48:51.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41082025-06-04T15:48:51.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41092025-06-04T15:48:51.838ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41102025-06-04T15:48:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41112025-06-04T15:48:51.841ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
41122025-06-04T15:48:51.841ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
41132025-06-04T15:48:51.841ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 91.194341ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
41142025-06-04T15:48:51.841ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41152025-06-04T15:48:51.841ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41162025-06-04T15:48:51.841ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 78.975821ms iteration = 27 status = {"errors":[],"requests_created_ok":[]}
41172025-06-04T15:48:51.842ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41182025-06-04T15:48:51.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41192025-06-04T15:48:51.843ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
41202025-06-04T15:48:51.843ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
41212025-06-04T15:48:51.843ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3a2843d7-1e1c-47e4-9521-1eb938c0106b dns_zone_name = oxide.test found_so_far = 0 version = 2
41222025-06-04T15:48:51.843ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41232025-06-04T15:48:51.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41242025-06-04T15:48:51.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41252025-06-04T15:48:51.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41262025-06-04T15:48:51.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41272025-06-04T15:48:51.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
41282025-06-04T15:48:51.845ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41292025-06-04T15:48:51.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41302025-06-04T15:48:51.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
41312025-06-04T15:48:51.845ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41322025-06-04T15:48:51.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41332025-06-04T15:48:51.847ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41342025-06-04T15:48:51.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41352025-06-04T15:48:51.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41362025-06-04T15:48:51.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41372025-06-04T15:48:51.851ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
41382025-06-04T15:48:51.851ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
41392025-06-04T15:48:51.851ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41402025-06-04T15:48:51.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41412025-06-04T15:48:51.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41422025-06-04T15:48:51.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41432025-06-04T15:48:51.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41442025-06-04T15:48:51.855ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3a2843d7-1e1c-47e4-9521-1eb938c0106b dns_zone_name = oxide.test found_so_far = 4 version = 2
41452025-06-04T15:48:51.855ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
41462025-06-04T15:48:51.855ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-04 15:35:55.637968 UTC dns_group = external generation = 2
41472025-06-04T15:48:51.855ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 107.048896ms iteration = 14 status = {"generation":2}
41482025-06-04T15:48:51.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e751cd2d-7b1b-4ea0-8b5a-62525772a5f5, lookup_type: ById(e751cd2d-7b1b-4ea0-8b5a-62525772a5f5) } result = Ok(())
41492025-06-04T15:48:51.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41502025-06-04T15:48:51.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41512025-06-04T15:48:51.856ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
41522025-06-04T15:48:51.856ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 105.790501ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
41532025-06-04T15:48:51.858ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 108.322292ms iteration = 27 status = 0
41542025-06-04T15:48:51.862ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
41552025-06-04T15:48:51.862ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 112.278511ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
41562025-06-04T15:48:51.872ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41572025-06-04T15:48:51.872ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
41582025-06-04T15:48:51.873ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 121.945429ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
41592025-06-04T15:48:51.880ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
41602025-06-04T15:48:51.880ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 4b1484ba-d395-4f36-93b6-c834b9680ee9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
41612025-06-04T15:48:51.880ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41622025-06-04T15:48:51.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41632025-06-04T15:48:51.882ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41642025-06-04T15:48:51.883ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41652025-06-04T15:48:51.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41662025-06-04T15:48:51.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41672025-06-04T15:48:51.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41682025-06-04T15:48:51.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41692025-06-04T15:48:51.886ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41702025-06-04T15:48:51.888ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 129.195338ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41712025-06-04T15:48:51.888ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41722025-06-04T15:48:51.888ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41732025-06-04T15:48:51.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41742025-06-04T15:48:51.889ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 4b1484ba-d395-4f36-93b6-c834b9680ee9 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
41752025-06-04T15:48:51.889ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
41762025-06-04T15:48:51.889ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-04 15:35:53.349408 UTC dns_group = internal generation = 1
41772025-06-04T15:48:51.889ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 140.860102ms iteration = 14 status = {"generation":1}
41782025-06-04T15:48:51.890ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 139.547916ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41792025-06-04T15:48:51.897ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
41802025-06-04T15:48:51.897ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 147.870019ms iteration = 27 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
41812025-06-04T15:48:51.900ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
41822025-06-04T15:48:51.900ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41832025-06-04T15:48:51.900ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d422709-aa1f-430c-a620-f5ea9204f079", "content-length": "26", "date": "Wed, 04 Jun 2025 15:48:51 GMT"} })
41842025-06-04T15:48:51.900ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41852025-06-04T15:48:51.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
41862025-06-04T15:48:51.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
41872025-06-04T15:48:51.902ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41882025-06-04T15:48:51.921ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
41892025-06-04T15:48:51.940ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-04T15:35:43.043689Z, time_modified: 2025-06-04T15:35:43.043689Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: bcca9629-d8e0-4351-a4fb-8029b18eb633, db_silo: Silo { identity: SiloIdentity { id: bcca9629-d8e0-4351-a4fb-8029b18eb633, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-04T15:35:55.573183Z, time_modified: 2025-06-04T15:35:55.573183Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a49af7a2313337b84535ddab02a38b7781b3f7789d0df44311ad2658fa92170d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: bcca9629-d8e0-4351-a4fb-8029b18eb633, db_silo: Silo { identity: SiloIdentity { id: bcca9629-d8e0-4351-a4fb-8029b18eb633, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-04T15:35:55.573183Z, time_modified: 2025-06-04T15:35:55.573183Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a49af7a2313337b84535ddab02a38b7781b3f7789d0df44311ad2658fa92170d" }] }) }
41902025-06-04T15:48:51.940ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 191.852459ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"bcca9629-d8e0-4351-a4fb-8029b18eb633","tls_certs":["a49af7a2313337b84535ddab02a38b7781b3f7789d0df44311ad2658fa92170d"]}},"default_endpoint":{"silo_id":"bcca9629-d8e0-4351-a4fb-8029b18eb633","tls_certs":["a49af7a2313337b84535ddab02a38b7781b3f7789d0df44311ad2658fa92170d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
41912025-06-04T15:48:51.947ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
41922025-06-04T15:48:51.947ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41932025-06-04T15:48:51.947ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c90f161-b2f0-49c0-8f7e-38c309274702", "content-length": "26", "date": "Wed, 04 Jun 2025 15:48:51 GMT"} })
41942025-06-04T15:48:51.947ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41952025-06-04T15:48:51.950ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41962025-06-04T15:48:51.951ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 201.552708ms iteration = 30 status = {"physical_disks_added":0}
41972025-06-04T15:48:51.974ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41982025-06-04T15:48:51.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41992025-06-04T15:48:51.990ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
42002025-06-04T15:48:52.089ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 zone_address = fd00:1122:3344:101::2
42012025-06-04T15:48:52.089ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42022025-06-04T15:48:52.089ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d53b8903-8deb-445a-af96-a962fea7f18e", "content-length": "26", "date": "Wed, 04 Jun 2025 15:48:51 GMT"} })
42032025-06-04T15:48:52.090ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42042025-06-04T15:48:52.091ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
42052025-06-04T15:48:52.091ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
42062025-06-04T15:48:52.091ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42072025-06-04T15:48:52.092ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b3c21ba-85dc-4b63-ade7-cdca5f527b98", "content-length": "372", "date": "Wed, 04 Jun 2025 15:48:51 GMT"} })
42082025-06-04T15:48:52.092ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42092025-06-04T15:48:52.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42102025-06-04T15:48:52.108ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42112025-06-04T15:48:52.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42122025-06-04T15:48:52.110ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 362.472976ms iteration = 27 status = null
42132025-06-04T15:48:52.129ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42142025-06-04T15:48:52.131ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42152025-06-04T15:48:52.131ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42162025-06-04T15:48:52.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42172025-06-04T15:48:52.146ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
42182025-06-04T15:48:52.146ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
42192025-06-04T15:48:52.146ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3a12999f-6c2d-40f1-936b-f2c732ac54d2", "date": "Wed, 04 Jun 2025 15:48:51 GMT"} })
42202025-06-04T15:48:52.146ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42212025-06-04T15:48:52.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42222025-06-04T15:48:52.149ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42232025-06-04T15:48:52.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42242025-06-04T15:48:52.153ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42252025-06-04T15:48:52.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42262025-06-04T15:48:52.156ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
42272025-06-04T15:48:52.156ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42282025-06-04T15:48:52.156ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3fb83b5b-f8c5-4871-825c-691e516ca434", "date": "Wed, 04 Jun 2025 15:48:51 GMT"} })
42292025-06-04T15:48:52.157ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 406.909703ms iteration = 28 status = {}
42302025-06-04T15:48:52.172ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42312025-06-04T15:48:52.174ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42322025-06-04T15:48:52.174ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42332025-06-04T15:48:52.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42342025-06-04T15:48:52.183ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
42352025-06-04T15:48:52.183ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7860f154-7a05-4ad1-8d48-303650a33e79", "date": "Wed, 04 Jun 2025 15:48:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42362025-06-04T15:48:52.183ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42372025-06-04T15:48:52.185ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "211ca260-8a2f-4b68-b4ad-ca217a8bd513", "date": "Wed, 04 Jun 2025 15:48:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42382025-06-04T15:48:52.185ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42392025-06-04T15:48:52.187ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42402025-06-04T15:48:52.187ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 439.511475ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
42412025-06-04T15:48:52.196ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
42422025-06-04T15:48:52.225ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 476.464058ms iteration = 27 status = {}
42432025-06-04T15:48:52.237ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
42442025-06-04T15:48:52.237ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 486.506131ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
42452025-06-04T15:48:52.260ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
42462025-06-04T15:48:52.261ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "96d470ee-d56c-418c-8507-b2dda59b109d", "date": "Wed, 04 Jun 2025 15:48:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42472025-06-04T15:48:52.261ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42482025-06-04T15:48:52.262ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "74306afa-8b11-4bc3-b122-1e9255baab5d", "date": "Wed, 04 Jun 2025 15:48:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42492025-06-04T15:48:52.262ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42502025-06-04T15:48:52.263ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b05d8662-10d6-4edf-a902-0f9cad7d3306", "date": "Wed, 04 Jun 2025 15:48:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42512025-06-04T15:48:52.263ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42522025-06-04T15:48:52.265ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
42532025-06-04T15:48:52.265ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 517.22656ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
42542025-06-04T15:48:52.307ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
42552025-06-04T15:48:52.308ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd8f6253-8718-4724-bb51-23090a0861b0", "content-length": "691", "date": "Wed, 04 Jun 2025 15:48:51 GMT"} })
42562025-06-04T15:48:52.308ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
42572025-06-04T15:48:52.308ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
42582025-06-04T15:48:52.308ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
42592025-06-04T15:48:52.309ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 558.798611ms iteration = 28 status = {}
42602025-06-04T15:48:52.311ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42612025-06-04T15:48:52.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42622025-06-04T15:48:52.312ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 8dbb977a-0cb9-4cf4-916b-4e19edd41b70, rack_id: 2302d566-cff7-41c0-b6e9-4f6ac6057661, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(aeecc71f-0b8d-4aaf-8e0e-04ee00063f7a) } rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0
42632025-06-04T15:48:52.312ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42642025-06-04T15:48:52.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42652025-06-04T15:48:52.326ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
42662025-06-04T15:48:52.326ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = aeecc71f-0b8d-4aaf-8e0e-04ee00063f7a
42672025-06-04T15:48:52.326ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
42682025-06-04T15:48:52.326ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42692025-06-04T15:48:52.326ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42702025-06-04T15:48:52.326ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42712025-06-04T15:48:52.326ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42722025-06-04T15:48:52.326ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42732025-06-04T15:48:52.327ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42742025-06-04T15:48:52.327ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42752025-06-04T15:48:52.327ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
42762025-06-04T15:48:52.327ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42772025-06-04T15:48:52.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42782025-06-04T15:48:52.329ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0
42792025-06-04T15:48:52.329ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
42802025-06-04T15:48:52.423ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "36a6b1be-d00c-4db1-bc7a-c9ad32c540a9", "date": "Wed, 04 Jun 2025 15:48:51 GMT"} })
42812025-06-04T15:48:52.423ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch = Switch0
42822025-06-04T15:48:52.423ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
42832025-06-04T15:48:52.424ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e56c673-c240-4ae4-91f6-47c39115f234", "content-length": "682", "date": "Wed, 04 Jun 2025 15:48:51 GMT"} })
42842025-06-04T15:48:52.424ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42852025-06-04T15:48:52.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42862025-06-04T15:48:52.428ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42872025-06-04T15:48:52.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42882025-06-04T15:48:52.431ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42892025-06-04T15:48:52.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42902025-06-04T15:48:52.432ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42912025-06-04T15:48:52.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42922025-06-04T15:48:52.441ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 691.32628ms iteration = 27 status = {}
42932025-06-04T15:48:52.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8d1f1f05-b93a-4d78-8f56-1042377344a2 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
42942025-06-04T15:48:52.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8d1f1f05-b93a-4d78-8f56-1042377344a2 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
42952025-06-04T15:48:52.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2411 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8d1f1f05-b93a-4d78-8f56-1042377344a2 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
42962025-06-04T15:48:53.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 78dd3b67-3749-413b-b55d-9a5b7e96fee8 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
42972025-06-04T15:48:53.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 78dd3b67-3749-413b-b55d-9a5b7e96fee8 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
42982025-06-04T15:48:53.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2633 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 78dd3b67-3749-413b-b55d-9a5b7e96fee8 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
42992025-06-04T15:48:54.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 1acf5c86-8916-49eb-a810-9565aed2210d roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43002025-06-04T15:48:54.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 1acf5c86-8916-49eb-a810-9565aed2210d resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43012025-06-04T15:48:54.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2621 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 1acf5c86-8916-49eb-a810-9565aed2210d response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43022025-06-04T15:48:55.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = baf5e23a-d49e-4766-9897-e247cf9677f9 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43032025-06-04T15:48:55.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = baf5e23a-d49e-4766-9897-e247cf9677f9 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43042025-06-04T15:48:55.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = baf5e23a-d49e-4766-9897-e247cf9677f9 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43052025-06-04T15:48:56.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b07450ab-c968-4a23-baad-23056d5ac801 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43062025-06-04T15:48:56.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b07450ab-c968-4a23-baad-23056d5ac801 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43072025-06-04T15:48:56.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2344 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b07450ab-c968-4a23-baad-23056d5ac801 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43082025-06-04T15:48:57.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3cd9b8c0-7f2f-4d4b-8a6c-9f5ce1bf849d roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43092025-06-04T15:48:57.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3cd9b8c0-7f2f-4d4b-8a6c-9f5ce1bf849d resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43102025-06-04T15:48:57.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2466 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3cd9b8c0-7f2f-4d4b-8a6c-9f5ce1bf849d response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43112025-06-04T15:48:58.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 23ee95d3-336e-479c-bcf6-bf6e18d6188c roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43122025-06-04T15:48:58.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 23ee95d3-336e-479c-bcf6-bf6e18d6188c resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43132025-06-04T15:48:58.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2584 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 23ee95d3-336e-479c-bcf6-bf6e18d6188c response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43142025-06-04T15:48:59.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 10c31518-3090-4588-a4a6-38981b9a1fd4 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43152025-06-04T15:48:59.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 10c31518-3090-4588-a4a6-38981b9a1fd4 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43162025-06-04T15:48:59.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 10c31518-3090-4588-a4a6-38981b9a1fd4 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43172025-06-04T15:48:59.952ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 579 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = a8088ec1-04cb-4e1b-9baa-c0200a9d7674 response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
43182025-06-04T15:49:00.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 04ef8385-23d4-493e-b38f-e0ec766e6d9b roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43192025-06-04T15:49:00.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 04ef8385-23d4-493e-b38f-e0ec766e6d9b resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43202025-06-04T15:49:00.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 04ef8385-23d4-493e-b38f-e0ec766e6d9b response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43212025-06-04T15:49:01.750ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
43222025-06-04T15:49:01.750ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43232025-06-04T15:49:01.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43242025-06-04T15:49:01.751ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
43252025-06-04T15:49:01.751ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43262025-06-04T15:49:01.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43272025-06-04T15:49:01.784ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43282025-06-04T15:49:01.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43292025-06-04T15:49:01.787ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43302025-06-04T15:49:01.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43312025-06-04T15:49:01.789ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43322025-06-04T15:49:01.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43332025-06-04T15:49:01.791ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43342025-06-04T15:49:01.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43352025-06-04T15:49:01.791ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43362025-06-04T15:49:01.793ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 42.088497ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43372025-06-04T15:49:01.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
43382025-06-04T15:49:01.794ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43392025-06-04T15:49:01.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43402025-06-04T15:49:01.805ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
43412025-06-04T15:49:01.805ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.048047ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
43422025-06-04T15:49:01.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7cbd844a-4cff-4d42-b134-2b56836eca61 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43432025-06-04T15:49:01.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7cbd844a-4cff-4d42-b134-2b56836eca61 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43442025-06-04T15:49:01.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7cbd844a-4cff-4d42-b134-2b56836eca61 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43452025-06-04T15:49:02.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3e61dfd6-14d1-4264-b28c-2af9161a1ce4 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43462025-06-04T15:49:02.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3e61dfd6-14d1-4264-b28c-2af9161a1ce4 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43472025-06-04T15:49:02.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2670 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3e61dfd6-14d1-4264-b28c-2af9161a1ce4 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43482025-06-04T15:49:03.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a6614b07-6e1e-4a11-a0c5-8e9099c7dd61 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43492025-06-04T15:49:03.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a6614b07-6e1e-4a11-a0c5-8e9099c7dd61 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43502025-06-04T15:49:03.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a6614b07-6e1e-4a11-a0c5-8e9099c7dd61 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43512025-06-04T15:49:04.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = c0955789-ec5a-488e-8132-77d59846a2a3 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43522025-06-04T15:49:04.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = c0955789-ec5a-488e-8132-77d59846a2a3 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43532025-06-04T15:49:04.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1716 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = c0955789-ec5a-488e-8132-77d59846a2a3 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43542025-06-04T15:49:05.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f455a16e-ffa6-45ba-91fe-0b4504b9eafe roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43552025-06-04T15:49:05.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f455a16e-ffa6-45ba-91fe-0b4504b9eafe resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43562025-06-04T15:49:05.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f455a16e-ffa6-45ba-91fe-0b4504b9eafe response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43572025-06-04T15:49:06.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a28eee9c-4487-42ba-888b-9c9e1d95df9c roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43582025-06-04T15:49:06.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a28eee9c-4487-42ba-888b-9c9e1d95df9c resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43592025-06-04T15:49:06.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a28eee9c-4487-42ba-888b-9c9e1d95df9c response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43602025-06-04T15:49:07.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5bf26e6f-6356-48bf-80ec-38d8d6d8a4b3 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43612025-06-04T15:49:07.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5bf26e6f-6356-48bf-80ec-38d8d6d8a4b3 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43622025-06-04T15:49:07.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5bf26e6f-6356-48bf-80ec-38d8d6d8a4b3 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43632025-06-04T15:49:08.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7af89ec1-a5ea-4143-b71c-04796cea2362 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43642025-06-04T15:49:08.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7af89ec1-a5ea-4143-b71c-04796cea2362 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43652025-06-04T15:49:08.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7af89ec1-a5ea-4143-b71c-04796cea2362 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43662025-06-04T15:49:09.952ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 593 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = 9323b26d-3ad1-4ac7-adc6-a2cd5994cea0 response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
43672025-06-04T15:49:09.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b019e41d-7952-4c45-93e4-b398984f941b roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43682025-06-04T15:49:09.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b019e41d-7952-4c45-93e4-b398984f941b resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43692025-06-04T15:49:09.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1900 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b019e41d-7952-4c45-93e4-b398984f941b response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43702025-06-04T15:49:10.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 15536abd-6114-49f8-b104-bbbfc797a2c9 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43712025-06-04T15:49:10.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 15536abd-6114-49f8-b104-bbbfc797a2c9 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43722025-06-04T15:49:10.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 15536abd-6114-49f8-b104-bbbfc797a2c9 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43732025-06-04T15:49:11.750ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
43742025-06-04T15:49:11.750ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43752025-06-04T15:49:11.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43762025-06-04T15:49:11.751ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
43772025-06-04T15:49:11.751ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43782025-06-04T15:49:11.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43792025-06-04T15:49:11.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43802025-06-04T15:49:11.755ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43812025-06-04T15:49:11.755ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43822025-06-04T15:49:11.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43832025-06-04T15:49:11.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43842025-06-04T15:49:11.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43852025-06-04T15:49:11.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43862025-06-04T15:49:11.761ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
43872025-06-04T15:49:11.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43882025-06-04T15:49:11.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43892025-06-04T15:49:11.770ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
43902025-06-04T15:49:11.770ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.774043ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
43912025-06-04T15:49:11.784ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43922025-06-04T15:49:11.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43932025-06-04T15:49:11.785ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.381792ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43942025-06-04T15:49:11.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 52d8c3f6-dcef-43d3-92ce-7d163c2f574f roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43952025-06-04T15:49:11.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 52d8c3f6-dcef-43d3-92ce-7d163c2f574f resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43962025-06-04T15:49:11.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1956 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 52d8c3f6-dcef-43d3-92ce-7d163c2f574f response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43972025-06-04T15:49:13.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 35136258-f6bc-4516-b0d8-2bc79ce095ef roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43982025-06-04T15:49:13.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 35136258-f6bc-4516-b0d8-2bc79ce095ef resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
43992025-06-04T15:49:13.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2547 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 35136258-f6bc-4516-b0d8-2bc79ce095ef response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44002025-06-04T15:49:14.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5a1ea4ec-5523-47ef-a2bc-7c48987750e8 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44012025-06-04T15:49:14.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5a1ea4ec-5523-47ef-a2bc-7c48987750e8 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44022025-06-04T15:49:14.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5a1ea4ec-5523-47ef-a2bc-7c48987750e8 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44032025-06-04T15:49:14.943ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:57005
44042025-06-04T15:49:14.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57005 req_id = e6838e1e-67d5-4bf8-a38b-6c67e399549c roles = RoleSet { roles: {} } uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?sort_by=id_ascending
44052025-06-04T15:49:14.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57005 req_id = e6838e1e-67d5-4bf8-a38b-6c67e399549c resource = Database result = Ok(()) uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?sort_by=id_ascending
44062025-06-04T15:49:14.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2789 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57005 req_id = e6838e1e-67d5-4bf8-a38b-6c67e399549c response_code = 200 uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?sort_by=id_ascending
44072025-06-04T15:49:14.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57005 req_id = b1dcef36-d8cf-4d3b-af08-053c8c991314 roles = RoleSet { roles: {} } uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzUxY2QyZC03YjFiLTRlYTAtOGI1YS02MjUyNTc3MmE1ZjUifX0%3D
44082025-06-04T15:49:14.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57005 req_id = b1dcef36-d8cf-4d3b-af08-053c8c991314 resource = Database result = Ok(()) uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzUxY2QyZC03YjFiLTRlYTAtOGI1YS02MjUyNTc3MmE1ZjUifX0%3D
44092025-06-04T15:49:14.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57005 req_id = b1dcef36-d8cf-4d3b-af08-053c8c991314 response_code = 200 uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzUxY2QyZC03YjFiLTRlYTAtOGI1YS02MjUyNTc3MmE1ZjUifX0%3D
44102025-06-04T15:49:15.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 063d6b98-9684-4562-8903-7a4369ababd7 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44112025-06-04T15:49:15.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 063d6b98-9684-4562-8903-7a4369ababd7 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44122025-06-04T15:49:15.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 063d6b98-9684-4562-8903-7a4369ababd7 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44132025-06-04T15:49:16.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5a9b9c4a-4e51-4f10-80ee-207a3a85c026 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44142025-06-04T15:49:16.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5a9b9c4a-4e51-4f10-80ee-207a3a85c026 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44152025-06-04T15:49:16.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2471 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5a9b9c4a-4e51-4f10-80ee-207a3a85c026 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44162025-06-04T15:49:17.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bead8d84-6d19-442b-81fe-69d9fddc194e roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44172025-06-04T15:49:17.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bead8d84-6d19-442b-81fe-69d9fddc194e resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44182025-06-04T15:49:17.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bead8d84-6d19-442b-81fe-69d9fddc194e response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44192025-06-04T15:49:18.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ff763178-e54c-43ed-921c-f161f9bb1896 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44202025-06-04T15:49:18.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ff763178-e54c-43ed-921c-f161f9bb1896 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44212025-06-04T15:49:18.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ff763178-e54c-43ed-921c-f161f9bb1896 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44222025-06-04T15:49:19.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e045b529-5ac9-4039-b982-81e3c7771e08 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44232025-06-04T15:49:19.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e045b529-5ac9-4039-b982-81e3c7771e08 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44242025-06-04T15:49:19.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2892 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e045b529-5ac9-4039-b982-81e3c7771e08 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44252025-06-04T15:49:19.952ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 514 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = c80c90b2-11bc-40e7-a1cc-9affb55415ab response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
44262025-06-04T15:49:20.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ecdc7f7a-4273-40e0-a7ca-060ae81fac69 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44272025-06-04T15:49:20.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ecdc7f7a-4273-40e0-a7ca-060ae81fac69 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44282025-06-04T15:49:20.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ecdc7f7a-4273-40e0-a7ca-060ae81fac69 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44292025-06-04T15:49:21.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = aa0a34e9-bb9d-4a8b-914b-92b9c5693fce roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44302025-06-04T15:49:21.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = aa0a34e9-bb9d-4a8b-914b-92b9c5693fce resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44312025-06-04T15:49:21.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = aa0a34e9-bb9d-4a8b-914b-92b9c5693fce response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
44322025-06-04T15:49:21.748ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
44332025-06-04T15:49:21.748ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
44342025-06-04T15:49:21.748ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
44352025-06-04T15:49:21.748ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44362025-06-04T15:49:21.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
44372025-06-04T15:49:21.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44382025-06-04T15:49:21.750ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
44392025-06-04T15:49:21.750ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
44402025-06-04T15:49:21.750ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 28 reason = Timeout
44412025-06-04T15:49:21.750ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44422025-06-04T15:49:21.750ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
44432025-06-04T15:49:21.750ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
44442025-06-04T15:49:21.750ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
44452025-06-04T15:49:21.750ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
44462025-06-04T15:49:21.750ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44472025-06-04T15:49:21.750ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44482025-06-04T15:49:21.750ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44492025-06-04T15:49:21.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
44502025-06-04T15:49:21.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44512025-06-04T15:49:21.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44522025-06-04T15:49:21.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44532025-06-04T15:49:21.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44542025-06-04T15:49:21.751ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
44552025-06-04T15:49:21.751ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
44562025-06-04T15:49:21.751ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
44572025-06-04T15:49:21.751ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
44582025-06-04T15:49:21.751ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
44592025-06-04T15:49:21.751ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44602025-06-04T15:49:21.751ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44612025-06-04T15:49:21.751ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44622025-06-04T15:49:21.751ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44632025-06-04T15:49:21.751ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
44642025-06-04T15:49:21.751ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
44652025-06-04T15:49:21.751ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44662025-06-04T15:49:21.751ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
44672025-06-04T15:49:21.751ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44682025-06-04T15:49:21.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44692025-06-04T15:49:21.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44702025-06-04T15:49:21.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44712025-06-04T15:49:21.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44722025-06-04T15:49:21.752ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2129, tv_nsec: 890766685 } })
44732025-06-04T15:49:21.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44742025-06-04T15:49:21.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44752025-06-04T15:49:21.752ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
44762025-06-04T15:49:21.752ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2129, tv_nsec: 891380062 } })
44772025-06-04T15:49:21.753ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
44782025-06-04T15:49:21.753ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44792025-06-04T15:49:21.753ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.958977ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
44802025-06-04T15:49:21.754ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44812025-06-04T15:49:21.755ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44822025-06-04T15:49:21.755ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44832025-06-04T15:49:21.755ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44842025-06-04T15:49:21.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
44852025-06-04T15:49:21.756ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
44862025-06-04T15:49:21.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
44872025-06-04T15:49:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
44882025-06-04T15:49:21.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44892025-06-04T15:49:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44902025-06-04T15:49:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44912025-06-04T15:49:21.758ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44922025-06-04T15:49:21.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44932025-06-04T15:49:21.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
44942025-06-04T15:49:21.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
44952025-06-04T15:49:21.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
44962025-06-04T15:49:21.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44972025-06-04T15:49:21.759ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
44982025-06-04T15:49:21.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
44992025-06-04T15:49:21.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45002025-06-04T15:49:21.759ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
45012025-06-04T15:49:21.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45022025-06-04T15:49:21.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
45032025-06-04T15:49:21.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
45042025-06-04T15:49:21.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45052025-06-04T15:49:21.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45062025-06-04T15:49:21.760ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45072025-06-04T15:49:21.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
45082025-06-04T15:49:21.760ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45092025-06-04T15:49:21.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45102025-06-04T15:49:21.760ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45112025-06-04T15:49:21.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45122025-06-04T15:49:21.763ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45132025-06-04T15:49:21.763ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45142025-06-04T15:49:21.763ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45152025-06-04T15:49:21.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45162025-06-04T15:49:21.763ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 28 reason = Timeout
45172025-06-04T15:49:21.763ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
45182025-06-04T15:49:21.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45192025-06-04T15:49:21.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
45202025-06-04T15:49:21.767ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45212025-06-04T15:49:21.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45222025-06-04T15:49:21.767ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2129, tv_nsec: 906500018 } })
45232025-06-04T15:49:21.768ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
45242025-06-04T15:49:21.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45252025-06-04T15:49:21.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45262025-06-04T15:49:21.771ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45272025-06-04T15:49:21.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45282025-06-04T15:49:21.771ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45292025-06-04T15:49:21.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45302025-06-04T15:49:21.772ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45312025-06-04T15:49:21.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45322025-06-04T15:49:21.774ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45332025-06-04T15:49:21.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45342025-06-04T15:49:21.807ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45352025-06-04T15:49:21.807ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
45362025-06-04T15:49:21.807ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45372025-06-04T15:49:21.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45382025-06-04T15:49:21.808ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45392025-06-04T15:49:21.810ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
45402025-06-04T15:49:21.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
45412025-06-04T15:49:21.811ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45422025-06-04T15:49:21.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45432025-06-04T15:49:21.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
45442025-06-04T15:49:21.812ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45452025-06-04T15:49:21.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45462025-06-04T15:49:21.813ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.337304ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45472025-06-04T15:49:21.813ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45482025-06-04T15:49:21.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45492025-06-04T15:49:21.813ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45502025-06-04T15:49:21.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45512025-06-04T15:49:21.815ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.875358ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
45522025-06-04T15:49:21.815ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45532025-06-04T15:49:21.816ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45542025-06-04T15:49:21.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45552025-06-04T15:49:21.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45562025-06-04T15:49:21.817ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.416015ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
45572025-06-04T15:49:21.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45582025-06-04T15:49:21.818ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45592025-06-04T15:49:21.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
45602025-06-04T15:49:21.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45612025-06-04T15:49:21.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45622025-06-04T15:49:21.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e751cd2d-7b1b-4ea0-8b5a-62525772a5f5, lookup_type: ById(e751cd2d-7b1b-4ea0-8b5a-62525772a5f5) } result = Ok(())
45632025-06-04T15:49:21.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45642025-06-04T15:49:21.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45652025-06-04T15:49:21.827ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 64.147989ms iteration = 28 status = {"errors":[],"requests_created_ok":[]}
45662025-06-04T15:49:21.828ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
45672025-06-04T15:49:21.828ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45682025-06-04T15:49:21.828ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2cb50b0-a92d-4a48-bf30-9052309a5b76", "content-length": "26", "date": "Wed, 04 Jun 2025 15:49:21 GMT"} })
45692025-06-04T15:49:21.829ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45702025-06-04T15:49:21.829ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 78.250812ms iteration = 28 status = 0
45712025-06-04T15:49:21.830ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 70.314565ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
45722025-06-04T15:49:21.830ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45732025-06-04T15:49:21.832ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
45742025-06-04T15:49:21.832ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45752025-06-04T15:49:21.832ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "84e884f6-da5c-4adb-ac81-4f1728bdea22", "content-length": "26", "date": "Wed, 04 Jun 2025 15:49:21 GMT"} })
45762025-06-04T15:49:21.832ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45772025-06-04T15:49:21.833ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45782025-06-04T15:49:21.834ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45792025-06-04T15:49:21.836ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45802025-06-04T15:49:21.836ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45812025-06-04T15:49:21.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45822025-06-04T15:49:21.839ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
45832025-06-04T15:49:21.840ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 89.202337ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
45842025-06-04T15:49:21.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 108.420713ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
45852025-06-04T15:49:21.864ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45862025-06-04T15:49:21.864ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
45872025-06-04T15:49:21.864ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45882025-06-04T15:49:21.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45892025-06-04T15:49:21.868ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 108.379603ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
45902025-06-04T15:49:21.871ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
45912025-06-04T15:49:21.871ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 119.524249ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
45922025-06-04T15:49:21.876ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45932025-06-04T15:49:21.877ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 zone_address = fd00:1122:3344:101::2
45942025-06-04T15:49:21.877ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45952025-06-04T15:49:21.878ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9fdedc1c-8cca-41df-a2de-fd8ee849d609", "content-length": "26", "date": "Wed, 04 Jun 2025 15:49:21 GMT"} })
45962025-06-04T15:49:21.878ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45972025-06-04T15:49:21.878ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
45982025-06-04T15:49:21.878ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
45992025-06-04T15:49:21.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46002025-06-04T15:49:21.880ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
46012025-06-04T15:49:21.916ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46022025-06-04T15:49:21.916ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
46032025-06-04T15:49:21.916ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 165.04044ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
46042025-06-04T15:49:21.919ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46052025-06-04T15:49:21.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46062025-06-04T15:49:21.921ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 172.656723ms iteration = 28 status = {}
46072025-06-04T15:49:21.922ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 173.610034ms iteration = 28 status = null
46082025-06-04T15:49:21.923ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46092025-06-04T15:49:21.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46102025-06-04T15:49:21.925ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
46112025-06-04T15:49:21.925ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 174.694408ms iteration = 28 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
46122025-06-04T15:49:21.926ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 175.893493ms iteration = 31 status = {"physical_disks_added":0}
46132025-06-04T15:49:22.009ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
46142025-06-04T15:49:22.009ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46152025-06-04T15:49:22.009ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e2f7f68-f293-4f8e-9596-9be9d1580526", "content-length": "372", "date": "Wed, 04 Jun 2025 15:49:21 GMT"} })
46162025-06-04T15:49:22.009ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46172025-06-04T15:49:22.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46182025-06-04T15:49:22.030ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
46192025-06-04T15:49:22.030ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
46202025-06-04T15:49:22.030ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "63b5622b-a755-4f75-9adb-c08502291709", "date": "Wed, 04 Jun 2025 15:49:21 GMT"} })
46212025-06-04T15:49:22.030ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46222025-06-04T15:49:22.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46232025-06-04T15:49:22.032ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46242025-06-04T15:49:22.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46252025-06-04T15:49:22.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46262025-06-04T15:49:22.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46272025-06-04T15:49:22.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46282025-06-04T15:49:22.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46292025-06-04T15:49:22.036ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 8dbb977a-0cb9-4cf4-916b-4e19edd41b70, rack_id: 2302d566-cff7-41c0-b6e9-4f6ac6057661, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(aeecc71f-0b8d-4aaf-8e0e-04ee00063f7a) } rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0
46302025-06-04T15:49:22.036ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46312025-06-04T15:49:22.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46322025-06-04T15:49:22.038ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
46332025-06-04T15:49:22.038ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46342025-06-04T15:49:22.039ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0151d1c8-fb09-499d-89cc-e30d15811d00", "date": "Wed, 04 Jun 2025 15:49:21 GMT"} })
46352025-06-04T15:49:22.040ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 289.002004ms iteration = 29 status = {}
46362025-06-04T15:49:22.047ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
46372025-06-04T15:49:22.047ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = aeecc71f-0b8d-4aaf-8e0e-04ee00063f7a
46382025-06-04T15:49:22.048ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
46392025-06-04T15:49:22.048ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46402025-06-04T15:49:22.048ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46412025-06-04T15:49:22.048ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46422025-06-04T15:49:22.048ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46432025-06-04T15:49:22.048ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46442025-06-04T15:49:22.048ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46452025-06-04T15:49:22.048ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46462025-06-04T15:49:22.048ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
46472025-06-04T15:49:22.048ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46482025-06-04T15:49:22.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46492025-06-04T15:49:22.051ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0
46502025-06-04T15:49:22.051ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
46512025-06-04T15:49:22.054ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46522025-06-04T15:49:22.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46532025-06-04T15:49:22.056ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46542025-06-04T15:49:22.058ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46552025-06-04T15:49:22.058ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46562025-06-04T15:49:22.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46572025-06-04T15:49:22.060ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46582025-06-04T15:49:22.062ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46592025-06-04T15:49:22.062ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46602025-06-04T15:49:22.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46612025-06-04T15:49:22.095ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46622025-06-04T15:49:22.165ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "053063bf-e649-4d36-9162-e251f12e5cdb", "date": "Wed, 04 Jun 2025 15:49:21 GMT"} })
46632025-06-04T15:49:22.165ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch = Switch0
46642025-06-04T15:49:22.165ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
46652025-06-04T15:49:22.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b276ec9c-6d5a-484c-a9ed-fd04794abe6e roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
46662025-06-04T15:49:22.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b276ec9c-6d5a-484c-a9ed-fd04794abe6e resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
46672025-06-04T15:49:22.166ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6d0bbe9-94ba-4e56-8451-3c8c68247cd9", "content-length": "691", "date": "Wed, 04 Jun 2025 15:49:21 GMT"} })
46682025-06-04T15:49:22.166ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2dfa737-0d8d-4235-b5c8-e31270cb1ae7", "content-length": "682", "date": "Wed, 04 Jun 2025 15:49:21 GMT"} })
46692025-06-04T15:49:22.166ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
46702025-06-04T15:49:22.166ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
46712025-06-04T15:49:22.166ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
46722025-06-04T15:49:22.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46732025-06-04T15:49:22.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46742025-06-04T15:49:22.167ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 415.412578ms iteration = 29 status = {}
46752025-06-04T15:49:22.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b276ec9c-6d5a-484c-a9ed-fd04794abe6e response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
46762025-06-04T15:49:22.169ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46772025-06-04T15:49:22.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46782025-06-04T15:49:22.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46792025-06-04T15:49:22.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46802025-06-04T15:49:22.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46812025-06-04T15:49:22.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46822025-06-04T15:49:22.183ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 432.777311ms iteration = 28 status = {}
46832025-06-04T15:49:22.694ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 5
46842025-06-04T15:49:22.694ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::c]:12221
46852025-06-04T15:49:22.724ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
46862025-06-04T15:49:22.724ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:64074
46872025-06-04T15:49:22.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:64074 req_id = 9c101e14-c0b1-46a1-ac36-b7523f5ef1a4 roles = RoleSet { roles: {} } uri = /metrics/producers
46882025-06-04T15:49:22.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:64074 req_id = 9c101e14-c0b1-46a1-ac36-b7523f5ef1a4 resource = Database result = Ok(()) uri = /metrics/producers
46892025-06-04T15:49:22.773ZINFOnexus: assigned collector to new producer collector_id = 93dd7779-b561-4a6e-a81b-f44350333434 file = nexus/src/app/oximeter.rs:76 producer_id = 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
46902025-06-04T15:49:22.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 49166 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:64074 req_id = 9c101e14-c0b1-46a1-ac36-b7523f5ef1a4 response_code = 201 uri = /metrics/producers
46912025-06-04T15:49:22.773ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "9c101e14-c0b1-46a1-ac36-b7523f5ef1a4", "content-length": "41", "date": "Wed, 04 Jun 2025 15:49:22 GMT"} })
46922025-06-04T15:49:22.774ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
46932025-06-04T15:49:23.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 621ec2d2-136b-4624-8041-9d7f8c9a684b roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
46942025-06-04T15:49:23.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 621ec2d2-136b-4624-8041-9d7f8c9a684b resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
46952025-06-04T15:49:23.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2173 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 621ec2d2-136b-4624-8041-9d7f8c9a684b response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
46962025-06-04T15:49:24.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = eda7af38-adf2-4b50-b838-c01233eada88 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
46972025-06-04T15:49:24.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = eda7af38-adf2-4b50-b838-c01233eada88 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
46982025-06-04T15:49:24.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1973 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = eda7af38-adf2-4b50-b838-c01233eada88 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
46992025-06-04T15:49:25.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = fa0197d0-5eae-495c-a9ea-c129357ccb57 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47002025-06-04T15:49:25.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = fa0197d0-5eae-495c-a9ea-c129357ccb57 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47012025-06-04T15:49:25.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = fa0197d0-5eae-495c-a9ea-c129357ccb57 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47022025-06-04T15:49:26.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a3080c47-5df5-4390-989d-0f3b6793a8eb roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47032025-06-04T15:49:26.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a3080c47-5df5-4390-989d-0f3b6793a8eb resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47042025-06-04T15:49:26.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a3080c47-5df5-4390-989d-0f3b6793a8eb response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47052025-06-04T15:49:27.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b4ad84a2-f3e0-436a-80b6-8540c507d6de roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47062025-06-04T15:49:27.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b4ad84a2-f3e0-436a-80b6-8540c507d6de resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47072025-06-04T15:49:27.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b4ad84a2-f3e0-436a-80b6-8540c507d6de response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47082025-06-04T15:49:28.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b80dfbcb-96c0-4e41-88e1-ed0591119a36 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47092025-06-04T15:49:28.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b80dfbcb-96c0-4e41-88e1-ed0591119a36 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47102025-06-04T15:49:28.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b80dfbcb-96c0-4e41-88e1-ed0591119a36 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47112025-06-04T15:49:29.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 60dd1b3d-9d8c-4e06-aa7b-85b4589ef0b9 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47122025-06-04T15:49:29.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 60dd1b3d-9d8c-4e06-aa7b-85b4589ef0b9 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47132025-06-04T15:49:29.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1923 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 60dd1b3d-9d8c-4e06-aa7b-85b4589ef0b9 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47142025-06-04T15:49:29.953ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 595 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = 8ad372ca-ed63-488b-ab31-143bb758f6b2 response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
47152025-06-04T15:49:30.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = fc9b8b4e-6e05-4fd9-849b-db8eee75fac1 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47162025-06-04T15:49:30.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = fc9b8b4e-6e05-4fd9-849b-db8eee75fac1 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47172025-06-04T15:49:30.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = fc9b8b4e-6e05-4fd9-849b-db8eee75fac1 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47182025-06-04T15:49:31.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0abc9be6-bdde-4ba0-a8e2-1400b1a6b64d roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47192025-06-04T15:49:31.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0abc9be6-bdde-4ba0-a8e2-1400b1a6b64d resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47202025-06-04T15:49:31.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0abc9be6-bdde-4ba0-a8e2-1400b1a6b64d response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47212025-06-04T15:49:31.750ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
47222025-06-04T15:49:31.750ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47232025-06-04T15:49:31.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47242025-06-04T15:49:31.751ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
47252025-06-04T15:49:31.751ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47262025-06-04T15:49:31.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47272025-06-04T15:49:31.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47282025-06-04T15:49:31.753ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47292025-06-04T15:49:31.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47302025-06-04T15:49:31.755ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.427962ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47312025-06-04T15:49:31.755ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47322025-06-04T15:49:31.755ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47332025-06-04T15:49:31.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47342025-06-04T15:49:31.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47352025-06-04T15:49:31.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47362025-06-04T15:49:31.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47372025-06-04T15:49:31.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
47382025-06-04T15:49:31.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47392025-06-04T15:49:31.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47402025-06-04T15:49:31.773ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
47412025-06-04T15:49:31.773ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.70112ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
47422025-06-04T15:49:32.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 57f25ae1-2006-4f4d-b7ba-598976481a66 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47432025-06-04T15:49:32.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 57f25ae1-2006-4f4d-b7ba-598976481a66 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47442025-06-04T15:49:32.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2640 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 57f25ae1-2006-4f4d-b7ba-598976481a66 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47452025-06-04T15:49:33.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 1acc8ddd-805f-489f-981e-35127c36fec6 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47462025-06-04T15:49:33.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 1acc8ddd-805f-489f-981e-35127c36fec6 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47472025-06-04T15:49:33.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1909 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 1acc8ddd-805f-489f-981e-35127c36fec6 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47482025-06-04T15:49:34.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 08c4fa29-1f74-469e-8d45-711cb7e9652f roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47492025-06-04T15:49:34.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 08c4fa29-1f74-469e-8d45-711cb7e9652f resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47502025-06-04T15:49:34.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2351 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 08c4fa29-1f74-469e-8d45-711cb7e9652f response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47512025-06-04T15:49:35.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9bf9cf55-843b-4fc0-a6a1-4df14c58cb06 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47522025-06-04T15:49:35.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9bf9cf55-843b-4fc0-a6a1-4df14c58cb06 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47532025-06-04T15:49:35.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2737 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9bf9cf55-843b-4fc0-a6a1-4df14c58cb06 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47542025-06-04T15:49:36.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f8d91e37-81ea-431a-9364-3772a17c6a89 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47552025-06-04T15:49:36.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f8d91e37-81ea-431a-9364-3772a17c6a89 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47562025-06-04T15:49:36.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f8d91e37-81ea-431a-9364-3772a17c6a89 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47572025-06-04T15:49:37.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e99bf626-c9d5-4dee-97b2-1f8ad5c4f221 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47582025-06-04T15:49:37.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e99bf626-c9d5-4dee-97b2-1f8ad5c4f221 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47592025-06-04T15:49:37.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e99bf626-c9d5-4dee-97b2-1f8ad5c4f221 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47602025-06-04T15:49:38.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 34c5791a-fa8b-4861-a80c-07912577e87a roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47612025-06-04T15:49:38.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 34c5791a-fa8b-4861-a80c-07912577e87a resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47622025-06-04T15:49:38.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 34c5791a-fa8b-4861-a80c-07912577e87a response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47632025-06-04T15:49:39.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f4e77654-d855-485b-8e21-82160b8235b2 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47642025-06-04T15:49:39.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f4e77654-d855-485b-8e21-82160b8235b2 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47652025-06-04T15:49:39.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2545 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f4e77654-d855-485b-8e21-82160b8235b2 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47662025-06-04T15:49:39.952ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 513 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = a33c5099-5e02-42cf-9045-0cf6778aa7f5 response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
47672025-06-04T15:49:40.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = fab1b847-0a65-445f-abfc-f917e05376bc roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47682025-06-04T15:49:40.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = fab1b847-0a65-445f-abfc-f917e05376bc resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47692025-06-04T15:49:40.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = fab1b847-0a65-445f-abfc-f917e05376bc response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47702025-06-04T15:49:41.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0fc6496a-8b6b-466e-b44d-73e7505aa70a roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47712025-06-04T15:49:41.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0fc6496a-8b6b-466e-b44d-73e7505aa70a resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47722025-06-04T15:49:41.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2458 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 0fc6496a-8b6b-466e-b44d-73e7505aa70a response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47732025-06-04T15:49:41.751ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
47742025-06-04T15:49:41.751ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47752025-06-04T15:49:41.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47762025-06-04T15:49:41.752ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
47772025-06-04T15:49:41.752ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47782025-06-04T15:49:41.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47792025-06-04T15:49:41.753ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47802025-06-04T15:49:41.753ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47812025-06-04T15:49:41.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47822025-06-04T15:49:41.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47832025-06-04T15:49:41.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47842025-06-04T15:49:41.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47852025-06-04T15:49:41.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47862025-06-04T15:49:41.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47872025-06-04T15:49:41.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47882025-06-04T15:49:41.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
47892025-06-04T15:49:41.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47902025-06-04T15:49:41.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47912025-06-04T15:49:41.774ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
47922025-06-04T15:49:41.774ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.72755ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
47932025-06-04T15:49:41.792ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.344676ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47942025-06-04T15:49:42.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = fe750d3e-21f8-46b3-9418-e8b7b93380cf roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47952025-06-04T15:49:42.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = fe750d3e-21f8-46b3-9418-e8b7b93380cf resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47962025-06-04T15:49:42.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = fe750d3e-21f8-46b3-9418-e8b7b93380cf response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47972025-06-04T15:49:43.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ae156bad-93df-4b9f-b947-889dce776e5b roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47982025-06-04T15:49:43.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ae156bad-93df-4b9f-b947-889dce776e5b resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
47992025-06-04T15:49:43.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ae156bad-93df-4b9f-b947-889dce776e5b response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48002025-06-04T15:49:44.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9186b74a-e460-443e-9205-93499a44c81c roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48012025-06-04T15:49:44.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9186b74a-e460-443e-9205-93499a44c81c resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48022025-06-04T15:49:44.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9186b74a-e460-443e-9205-93499a44c81c response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48032025-06-04T15:49:44.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57005 req_id = 0ef2d96a-09fd-47a0-a8c6-4c6115d0b9ae roles = RoleSet { roles: {} } uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?sort_by=id_ascending
48042025-06-04T15:49:44.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57005 req_id = 0ef2d96a-09fd-47a0-a8c6-4c6115d0b9ae resource = Database result = Ok(()) uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?sort_by=id_ascending
48052025-06-04T15:49:44.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57005 req_id = 0ef2d96a-09fd-47a0-a8c6-4c6115d0b9ae response_code = 200 uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?sort_by=id_ascending
48062025-06-04T15:49:44.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57005 req_id = 9222706f-1462-4d4e-bc04-60343bb6fb61 roles = RoleSet { roles: {} } uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzUxY2QyZC03YjFiLTRlYTAtOGI1YS02MjUyNTc3MmE1ZjUifX0%3D
48072025-06-04T15:49:44.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57005 req_id = 9222706f-1462-4d4e-bc04-60343bb6fb61 resource = Database result = Ok(()) uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzUxY2QyZC03YjFiLTRlYTAtOGI1YS02MjUyNTc3MmE1ZjUifX0%3D
48082025-06-04T15:49:44.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57005 req_id = 9222706f-1462-4d4e-bc04-60343bb6fb61 response_code = 200 uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzUxY2QyZC03YjFiLTRlYTAtOGI1YS02MjUyNTc3MmE1ZjUifX0%3D
48092025-06-04T15:49:45.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2b5e03e3-b7c7-4236-9661-fce43b5f2645 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48102025-06-04T15:49:45.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2b5e03e3-b7c7-4236-9661-fce43b5f2645 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48112025-06-04T15:49:45.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2057 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2b5e03e3-b7c7-4236-9661-fce43b5f2645 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48122025-06-04T15:49:46.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 69f6c2f1-068b-40f6-9798-2f4a485b23f2 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48132025-06-04T15:49:46.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 69f6c2f1-068b-40f6-9798-2f4a485b23f2 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48142025-06-04T15:49:46.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 69f6c2f1-068b-40f6-9798-2f4a485b23f2 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48152025-06-04T15:49:47.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f5452be2-0a06-4d77-bab5-cd70e169035b roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48162025-06-04T15:49:47.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f5452be2-0a06-4d77-bab5-cd70e169035b resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48172025-06-04T15:49:47.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2100 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f5452be2-0a06-4d77-bab5-cd70e169035b response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48182025-06-04T15:49:48.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f798da60-63a3-47a1-8119-01abdccc5554 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48192025-06-04T15:49:48.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f798da60-63a3-47a1-8119-01abdccc5554 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48202025-06-04T15:49:48.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f798da60-63a3-47a1-8119-01abdccc5554 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48212025-06-04T15:49:49.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 03363692-d2cb-45a2-9626-53a5b26f1447 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48222025-06-04T15:49:49.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 03363692-d2cb-45a2-9626-53a5b26f1447 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48232025-06-04T15:49:49.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 03363692-d2cb-45a2-9626-53a5b26f1447 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48242025-06-04T15:49:49.952ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 518 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = 79316eea-0d36-4849-a9f8-5d0728ef362f response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
48252025-06-04T15:49:50.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 20e6c5b4-6e9b-48b3-90ff-1b0881ff44b9 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48262025-06-04T15:49:50.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 20e6c5b4-6e9b-48b3-90ff-1b0881ff44b9 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48272025-06-04T15:49:50.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 20e6c5b4-6e9b-48b3-90ff-1b0881ff44b9 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48282025-06-04T15:49:51.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = acb7b6c8-a2aa-4fab-9e0b-0ca973ecb191 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48292025-06-04T15:49:51.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = acb7b6c8-a2aa-4fab-9e0b-0ca973ecb191 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48302025-06-04T15:49:51.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = acb7b6c8-a2aa-4fab-9e0b-0ca973ecb191 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
48312025-06-04T15:49:51.749ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
48322025-06-04T15:49:51.749ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48332025-06-04T15:49:51.749ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
48342025-06-04T15:49:51.749ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
48352025-06-04T15:49:51.749ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48362025-06-04T15:49:51.749ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
48372025-06-04T15:49:51.749ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
48382025-06-04T15:49:51.749ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48392025-06-04T15:49:51.749ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
48402025-06-04T15:49:51.749ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
48412025-06-04T15:49:51.749ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
48422025-06-04T15:49:51.749ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
48432025-06-04T15:49:51.749ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
48442025-06-04T15:49:51.749ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
48452025-06-04T15:49:51.749ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-04 15:39:51.749913164 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
48462025-06-04T15:49:51.749ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
48472025-06-04T15:49:51.749ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
48482025-06-04T15:49:51.749ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
48492025-06-04T15:49:51.749ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48502025-06-04T15:49:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48512025-06-04T15:49:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48522025-06-04T15:49:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48532025-06-04T15:49:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
48542025-06-04T15:49:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
48552025-06-04T15:49:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48562025-06-04T15:49:51.750ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("74458287-879a-4471-829f-da352f40aff2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("84104d89-910f-45b9-adb6-d23a6d4f41d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("84104d89-910f-45b9-adb6-d23a6d4f41d6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2159, tv_nsec: 888567977 } })
48572025-06-04T15:49:51.750ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d97642c-17fd-4803-bc28-7ad83219ce8c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("91bdae66-8e10-4892-9bfd-517dee32a9bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e10264ea-c7fb-4742-9452-fa5e125ebf3d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e10264ea-c7fb-4742-9452-fa5e125ebf3d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2159, tv_nsec: 888569837 } })
48582025-06-04T15:49:51.751ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
48592025-06-04T15:49:51.751ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.121284ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
48602025-06-04T15:49:51.751ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
48612025-06-04T15:49:51.751ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.226105ms iteration = 15 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
48622025-06-04T15:49:51.751ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48632025-06-04T15:49:51.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48642025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
48652025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48662025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
48672025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48682025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
48692025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48702025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
48712025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
48722025-06-04T15:49:51.752ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf
48732025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.78\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf"}
48742025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
48752025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
48762025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
48772025-06-04T15:49:51.752ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
48782025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
48792025-06-04T15:49:51.752ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
48802025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
48812025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48822025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
48832025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
48842025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48852025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48862025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
48872025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
48882025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48892025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 29 reason = Timeout
48902025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
48912025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
48922025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
48932025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48942025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48952025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
48962025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48972025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48982025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48992025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
49002025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49012025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49022025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
49032025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
49042025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49052025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49062025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49072025-06-04T15:49:51.752ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2159, tv_nsec: 890761704 } })
49082025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49092025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49102025-06-04T15:49:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49112025-06-04T15:49:51.753ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
49122025-06-04T15:49:51.753ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49132025-06-04T15:49:51.753ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49142025-06-04T15:49:51.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49152025-06-04T15:49:51.754ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2159, tv_nsec: 892234083 } })
49162025-06-04T15:49:51.754ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
49172025-06-04T15:49:51.755ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-04 15:39:51.749913164 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
49182025-06-04T15:49:51.755ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.493368ms iteration = 15 status = {"expiration":"2025-06-04T15:39:51.749913164Z","pruned":[]}
49192025-06-04T15:49:51.755ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49202025-06-04T15:49:51.755ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
49212025-06-04T15:49:51.755ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49222025-06-04T15:49:51.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49232025-06-04T15:49:51.757ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49242025-06-04T15:49:51.758ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49252025-06-04T15:49:51.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49262025-06-04T15:49:51.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
49272025-06-04T15:49:51.758ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.873574ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49282025-06-04T15:49:51.759ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
49292025-06-04T15:49:51.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49302025-06-04T15:49:51.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49312025-06-04T15:49:51.760ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
49322025-06-04T15:49:51.760ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49332025-06-04T15:49:51.760ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
49342025-06-04T15:49:51.760ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
49352025-06-04T15:49:51.760ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
49362025-06-04T15:49:51.760ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
49372025-06-04T15:49:51.760ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
49382025-06-04T15:49:51.760ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
49392025-06-04T15:49:51.760ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
49402025-06-04T15:49:51.760ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49412025-06-04T15:49:51.760ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
49422025-06-04T15:49:51.760ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
49432025-06-04T15:49:51.760ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49442025-06-04T15:49:51.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
49452025-06-04T15:49:51.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49462025-06-04T15:49:51.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49472025-06-04T15:49:51.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
49482025-06-04T15:49:51.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
49492025-06-04T15:49:51.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
49502025-06-04T15:49:51.761ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49512025-06-04T15:49:51.762ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49522025-06-04T15:49:51.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49532025-06-04T15:49:51.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
49542025-06-04T15:49:51.764ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49552025-06-04T15:49:51.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49562025-06-04T15:49:51.764ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 29 reason = Timeout
49572025-06-04T15:49:51.764ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
49582025-06-04T15:49:51.764ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 15 reason = Timeout
49592025-06-04T15:49:51.764ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
49602025-06-04T15:49:51.764ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 15 reason = Timeout
49612025-06-04T15:49:51.764ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
49622025-06-04T15:49:51.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
49632025-06-04T15:49:51.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
49642025-06-04T15:49:51.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
49652025-06-04T15:49:51.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
49662025-06-04T15:49:51.765ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
49672025-06-04T15:49:51.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
49682025-06-04T15:49:51.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
49692025-06-04T15:49:51.766ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
49702025-06-04T15:49:51.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
49712025-06-04T15:49:51.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49722025-06-04T15:49:51.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49732025-06-04T15:49:51.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49742025-06-04T15:49:51.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49752025-06-04T15:49:51.768ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49762025-06-04T15:49:51.771ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49772025-06-04T15:49:51.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49782025-06-04T15:49:51.771ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49792025-06-04T15:49:51.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49802025-06-04T15:49:51.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
49812025-06-04T15:49:51.772ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49822025-06-04T15:49:51.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49832025-06-04T15:49:51.772ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49842025-06-04T15:49:51.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49852025-06-04T15:49:51.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
49862025-06-04T15:49:51.776ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 15.780904ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
49872025-06-04T15:49:51.776ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49882025-06-04T15:49:51.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49892025-06-04T15:49:51.777ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2159, tv_nsec: 915448448 } })
49902025-06-04T15:49:51.777ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
49912025-06-04T15:49:51.779ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.833572ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
49922025-06-04T15:49:51.780ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
49932025-06-04T15:49:51.780ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 15.259457ms iteration = 15 status = {"by_rx":{},"error":null}
49942025-06-04T15:49:51.780ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
49952025-06-04T15:49:51.780ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
49962025-06-04T15:49:51.780ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
49972025-06-04T15:49:51.780ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49982025-06-04T15:49:51.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49992025-06-04T15:49:51.784ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
50002025-06-04T15:49:51.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
50012025-06-04T15:49:51.785ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
50022025-06-04T15:49:51.785ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 33.394411ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
50032025-06-04T15:49:51.786ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50042025-06-04T15:49:51.786ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50052025-06-04T15:49:51.786ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50062025-06-04T15:49:51.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50072025-06-04T15:49:51.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50082025-06-04T15:49:51.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50092025-06-04T15:49:51.789ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50102025-06-04T15:49:51.789ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50112025-06-04T15:49:51.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50122025-06-04T15:49:51.790ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50132025-06-04T15:49:51.790ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
50142025-06-04T15:49:51.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
50152025-06-04T15:49:51.792ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50162025-06-04T15:49:51.792ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50172025-06-04T15:49:51.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50182025-06-04T15:49:51.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50192025-06-04T15:49:51.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50202025-06-04T15:49:51.795ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50212025-06-04T15:49:51.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50222025-06-04T15:49:51.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
50232025-06-04T15:49:51.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50242025-06-04T15:49:51.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50252025-06-04T15:49:51.803ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 38.591465ms iteration = 15 status = {"dispatched":[],"errors":[],"glob_version":"147.0.0","globs_reprocessed":{},"no_receivers":[]}
50262025-06-04T15:49:51.813ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
50272025-06-04T15:49:51.813ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
50282025-06-04T15:49:51.813ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
50292025-06-04T15:49:51.813ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50302025-06-04T15:49:51.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50312025-06-04T15:49:51.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50322025-06-04T15:49:51.819ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50332025-06-04T15:49:51.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50342025-06-04T15:49:51.819ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50352025-06-04T15:49:51.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50362025-06-04T15:49:51.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50372025-06-04T15:49:51.822ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50382025-06-04T15:49:51.823ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50392025-06-04T15:49:51.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50402025-06-04T15:49:51.825ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50412025-06-04T15:49:51.825ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
50422025-06-04T15:49:51.825ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50432025-06-04T15:49:51.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50442025-06-04T15:49:51.826ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50452025-06-04T15:49:51.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50462025-06-04T15:49:51.826ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 65.600427ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
50472025-06-04T15:49:51.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50482025-06-04T15:49:51.828ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50492025-06-04T15:49:51.828ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50502025-06-04T15:49:51.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50512025-06-04T15:49:51.831ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
50522025-06-04T15:49:51.831ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 79.405947ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
50532025-06-04T15:49:51.831ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50542025-06-04T15:49:51.831ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50552025-06-04T15:49:51.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50562025-06-04T15:49:51.833ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 81.854206ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50572025-06-04T15:49:51.835ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50582025-06-04T15:49:51.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50592025-06-04T15:49:51.839ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50602025-06-04T15:49:51.840ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 79.858882ms iteration = 29 status = {"errors":[],"finish_invoked_ok":[]}
50612025-06-04T15:49:51.843ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50622025-06-04T15:49:51.843ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50632025-06-04T15:49:51.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
50642025-06-04T15:49:51.843ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
50652025-06-04T15:49:51.843ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
50662025-06-04T15:49:51.843ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
50672025-06-04T15:49:51.843ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 83.045431ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
50682025-06-04T15:49:51.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
50692025-06-04T15:49:51.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e751cd2d-7b1b-4ea0-8b5a-62525772a5f5, lookup_type: ById(e751cd2d-7b1b-4ea0-8b5a-62525772a5f5) } result = Ok(())
50702025-06-04T15:49:51.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50712025-06-04T15:49:51.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50722025-06-04T15:49:51.847ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
50732025-06-04T15:49:51.847ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
50742025-06-04T15:49:51.847ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 95.1431ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
50752025-06-04T15:49:51.847ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 86.696306ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
50762025-06-04T15:49:51.848ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
50772025-06-04T15:49:51.848ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50782025-06-04T15:49:51.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50792025-06-04T15:49:51.850ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 85.090216ms iteration = 29 status = {"errors":[],"requests_created_ok":[]}
50802025-06-04T15:49:51.855ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
50812025-06-04T15:49:51.855ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3a2843d7-1e1c-47e4-9521-1eb938c0106b dns_zone_name = oxide.test found_so_far = 0 version = 2
50822025-06-04T15:49:51.855ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50832025-06-04T15:49:51.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50842025-06-04T15:49:51.859ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 107.39179ms iteration = 32 status = {"physical_disks_added":0}
50852025-06-04T15:49:51.871ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
50862025-06-04T15:49:51.871ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 4b1484ba-d395-4f36-93b6-c834b9680ee9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
50872025-06-04T15:49:51.871ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50882025-06-04T15:49:51.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50892025-06-04T15:49:51.874ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 122.540176ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
50902025-06-04T15:49:51.876ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50912025-06-04T15:49:51.876ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50922025-06-04T15:49:51.876ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50932025-06-04T15:49:51.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50942025-06-04T15:49:51.899ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
50952025-06-04T15:49:51.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
50962025-06-04T15:49:51.910ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50972025-06-04T15:49:51.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50982025-06-04T15:49:51.936ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
50992025-06-04T15:49:51.936ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51002025-06-04T15:49:51.936ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f9af569-6971-421b-806b-88f27ded10f4", "content-length": "26", "date": "Wed, 04 Jun 2025 15:49:51 GMT"} })
51012025-06-04T15:49:51.936ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51022025-06-04T15:49:51.937ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51032025-06-04T15:49:51.954ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
51042025-06-04T15:49:51.969ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 zone_address = fd00:1122:3344:101::2
51052025-06-04T15:49:51.969ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51062025-06-04T15:49:51.969ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6081f314-9ca9-4187-8a42-4c031525b419", "content-length": "26", "date": "Wed, 04 Jun 2025 15:49:51 GMT"} })
51072025-06-04T15:49:51.969ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51082025-06-04T15:49:51.971ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
51092025-06-04T15:49:52.042ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
51102025-06-04T15:49:52.086ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
51112025-06-04T15:49:52.086ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51122025-06-04T15:49:52.087ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce35244e-6888-432d-995c-da1ed6977a6d", "content-length": "26", "date": "Wed, 04 Jun 2025 15:49:51 GMT"} })
51132025-06-04T15:49:52.087ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51142025-06-04T15:49:52.088ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51152025-06-04T15:49:52.110ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51162025-06-04T15:49:52.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51172025-06-04T15:49:52.187ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
51182025-06-04T15:49:52.187ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51192025-06-04T15:49:52.187ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b90e36e-d153-4534-83d3-c1e91456edf1", "content-length": "372", "date": "Wed, 04 Jun 2025 15:49:51 GMT"} })
51202025-06-04T15:49:52.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51212025-06-04T15:49:52.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51222025-06-04T15:49:52.190ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 437.836053ms iteration = 29 status = 0
51232025-06-04T15:49:52.190ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51242025-06-04T15:49:52.190ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51252025-06-04T15:49:52.195ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51262025-06-04T15:49:52.195ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51272025-06-04T15:49:52.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51282025-06-04T15:49:52.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51292025-06-04T15:49:52.196ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51302025-06-04T15:49:52.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51312025-06-04T15:49:52.198ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 449.111291ms iteration = 29 status = null
51322025-06-04T15:49:52.200ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 4b1484ba-d395-4f36-93b6-c834b9680ee9 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
51332025-06-04T15:49:52.200ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
51342025-06-04T15:49:52.200ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-04 15:35:53.349408 UTC dns_group = internal generation = 1
51352025-06-04T15:49:52.200ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 450.707342ms iteration = 15 status = {"generation":1}
51362025-06-04T15:49:52.202ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3a2843d7-1e1c-47e4-9521-1eb938c0106b dns_zone_name = oxide.test found_so_far = 4 version = 2
51372025-06-04T15:49:52.202ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
51382025-06-04T15:49:52.202ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-04 15:35:55.637968 UTC dns_group = external generation = 2
51392025-06-04T15:49:52.202ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 452.610406ms iteration = 15 status = {"generation":2}
51402025-06-04T15:49:52.211ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
51412025-06-04T15:49:52.223ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
51422025-06-04T15:49:52.224ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5d42254c-dfe1-4b32-ba5b-de1868593e2d", "date": "Wed, 04 Jun 2025 15:49:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51432025-06-04T15:49:52.224ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51442025-06-04T15:49:52.225ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0ae68afe-7903-42d2-b2ef-622a66d1bf01", "date": "Wed, 04 Jun 2025 15:49:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51452025-06-04T15:49:52.225ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51462025-06-04T15:49:52.227ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51472025-06-04T15:49:52.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51482025-06-04T15:49:52.227ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51492025-06-04T15:49:52.227ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 477.928517ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
51502025-06-04T15:49:52.227ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51512025-06-04T15:49:52.227ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
51522025-06-04T15:49:52.227ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 475.696229ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
51532025-06-04T15:49:52.229ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
51542025-06-04T15:49:52.229ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 477.461701ms iteration = 29 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
51552025-06-04T15:49:52.230ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 480.120973ms iteration = 29 status = {}
51562025-06-04T15:49:52.244ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
51572025-06-04T15:49:52.244ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
51582025-06-04T15:49:52.245ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d54d3300-a34a-40e2-a1ab-7adffb130791", "date": "Wed, 04 Jun 2025 15:49:51 GMT"} })
51592025-06-04T15:49:52.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51602025-06-04T15:49:52.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51612025-06-04T15:49:52.247ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51622025-06-04T15:49:52.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51632025-06-04T15:49:52.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51642025-06-04T15:49:52.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51652025-06-04T15:49:52.253ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
51662025-06-04T15:49:52.253ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51672025-06-04T15:49:52.254ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7b9dc1fe-91b0-41e4-b861-29104a3b865f", "date": "Wed, 04 Jun 2025 15:49:51 GMT"} })
51682025-06-04T15:49:52.256ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 504.038188ms iteration = 30 status = {}
51692025-06-04T15:49:52.266ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51702025-06-04T15:49:52.268ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
51712025-06-04T15:49:52.268ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51722025-06-04T15:49:52.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51732025-06-04T15:49:52.284ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
51742025-06-04T15:49:52.285ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "584c8245-8ac5-4061-8ea5-800572803465", "date": "Wed, 04 Jun 2025 15:49:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
51752025-06-04T15:49:52.285ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
51762025-06-04T15:49:52.286ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "84df53fe-d6fc-454e-b3e1-56cd863e2844", "date": "Wed, 04 Jun 2025 15:49:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
51772025-06-04T15:49:52.286ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
51782025-06-04T15:49:52.287ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "79cb30f7-11d5-43f4-8c1f-99cbe88bda8f", "date": "Wed, 04 Jun 2025 15:49:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
51792025-06-04T15:49:52.287ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
51802025-06-04T15:49:52.289ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
51812025-06-04T15:49:52.289ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 539.717225ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
51822025-06-04T15:49:52.300ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51832025-06-04T15:49:52.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51842025-06-04T15:49:52.302ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-04T15:35:43.043689Z, time_modified: 2025-06-04T15:35:43.043689Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: bcca9629-d8e0-4351-a4fb-8029b18eb633, db_silo: Silo { identity: SiloIdentity { id: bcca9629-d8e0-4351-a4fb-8029b18eb633, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-04T15:35:55.573183Z, time_modified: 2025-06-04T15:35:55.573183Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a49af7a2313337b84535ddab02a38b7781b3f7789d0df44311ad2658fa92170d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: bcca9629-d8e0-4351-a4fb-8029b18eb633, db_silo: Silo { identity: SiloIdentity { id: bcca9629-d8e0-4351-a4fb-8029b18eb633, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-04T15:35:55.573183Z, time_modified: 2025-06-04T15:35:55.573183Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a49af7a2313337b84535ddab02a38b7781b3f7789d0df44311ad2658fa92170d" }] }) }
51852025-06-04T15:49:52.302ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 552.597165ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"bcca9629-d8e0-4351-a4fb-8029b18eb633","tls_certs":["a49af7a2313337b84535ddab02a38b7781b3f7789d0df44311ad2658fa92170d"]}},"default_endpoint":{"silo_id":"bcca9629-d8e0-4351-a4fb-8029b18eb633","tls_certs":["a49af7a2313337b84535ddab02a38b7781b3f7789d0df44311ad2658fa92170d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
51862025-06-04T15:49:52.303ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 8dbb977a-0cb9-4cf4-916b-4e19edd41b70, rack_id: 2302d566-cff7-41c0-b6e9-4f6ac6057661, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(aeecc71f-0b8d-4aaf-8e0e-04ee00063f7a) } rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0
51872025-06-04T15:49:52.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51882025-06-04T15:49:52.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51892025-06-04T15:49:52.303ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
51902025-06-04T15:49:52.303ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 551.743914ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
51912025-06-04T15:49:52.313ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51922025-06-04T15:49:52.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51932025-06-04T15:49:52.315ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
51942025-06-04T15:49:52.315ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = aeecc71f-0b8d-4aaf-8e0e-04ee00063f7a
51952025-06-04T15:49:52.316ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
51962025-06-04T15:49:52.316ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
51972025-06-04T15:49:52.316ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51982025-06-04T15:49:52.316ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51992025-06-04T15:49:52.316ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52002025-06-04T15:49:52.316ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52012025-06-04T15:49:52.316ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52022025-06-04T15:49:52.316ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52032025-06-04T15:49:52.316ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
52042025-06-04T15:49:52.316ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52052025-06-04T15:49:52.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52062025-06-04T15:49:52.318ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0
52072025-06-04T15:49:52.318ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
52082025-06-04T15:49:52.352ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52092025-06-04T15:49:52.354ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52102025-06-04T15:49:52.354ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52112025-06-04T15:49:52.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52122025-06-04T15:49:52.356ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52132025-06-04T15:49:52.358ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52142025-06-04T15:49:52.358ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52152025-06-04T15:49:52.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52162025-06-04T15:49:52.436ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0f442641-336b-4f9d-b5a3-930f9c363ee9", "date": "Wed, 04 Jun 2025 15:49:51 GMT"} })
52172025-06-04T15:49:52.436ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch = Switch0
52182025-06-04T15:49:52.436ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
52192025-06-04T15:49:52.436ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2d645af-a66c-44f3-a841-82e39e88f3c5", "content-length": "682", "date": "Wed, 04 Jun 2025 15:49:51 GMT"} })
52202025-06-04T15:49:52.436ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52212025-06-04T15:49:52.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52222025-06-04T15:49:52.444ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52232025-06-04T15:49:52.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52242025-06-04T15:49:52.449ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52252025-06-04T15:49:52.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52262025-06-04T15:49:52.451ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52272025-06-04T15:49:52.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52282025-06-04T15:49:52.458ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 706.75527ms iteration = 29 status = {}
52292025-06-04T15:49:52.461ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
52302025-06-04T15:49:52.462ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "78ddd38c-ed1e-4bf3-ba1a-6c6011558b1b", "content-length": "691", "date": "Wed, 04 Jun 2025 15:49:52 GMT"} })
52312025-06-04T15:49:52.462ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
52322025-06-04T15:49:52.462ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
52332025-06-04T15:49:52.462ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
52342025-06-04T15:49:52.463ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 711.265045ms iteration = 30 status = {}
52352025-06-04T15:49:52.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 475fedb9-863c-43bd-ab43-d49d63c838ff roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52362025-06-04T15:49:52.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 475fedb9-863c-43bd-ab43-d49d63c838ff resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52372025-06-04T15:49:52.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 475fedb9-863c-43bd-ab43-d49d63c838ff response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52382025-06-04T15:49:53.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e7e8fc5a-ad09-4ab0-9ef1-b9a50807596c roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52392025-06-04T15:49:53.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e7e8fc5a-ad09-4ab0-9ef1-b9a50807596c resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52402025-06-04T15:49:53.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2663 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e7e8fc5a-ad09-4ab0-9ef1-b9a50807596c response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52412025-06-04T15:49:54.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9dde0c8f-73ec-4df0-ac74-0c963836dbea roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52422025-06-04T15:49:54.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9dde0c8f-73ec-4df0-ac74-0c963836dbea resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52432025-06-04T15:49:54.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2754 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9dde0c8f-73ec-4df0-ac74-0c963836dbea response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52442025-06-04T15:49:55.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 503d9f62-cfbd-481d-b9f9-0a26f42e0f7c roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52452025-06-04T15:49:55.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 503d9f62-cfbd-481d-b9f9-0a26f42e0f7c resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52462025-06-04T15:49:55.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 503d9f62-cfbd-481d-b9f9-0a26f42e0f7c response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52472025-06-04T15:49:56.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = acc3ca24-0b31-4fd0-84ff-cf4dd3cde87f roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52482025-06-04T15:49:56.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = acc3ca24-0b31-4fd0-84ff-cf4dd3cde87f resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52492025-06-04T15:49:56.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2558 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = acc3ca24-0b31-4fd0-84ff-cf4dd3cde87f response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52502025-06-04T15:49:57.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9a44aa0e-cb1b-4355-b859-eafe88ea54b3 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52512025-06-04T15:49:57.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9a44aa0e-cb1b-4355-b859-eafe88ea54b3 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52522025-06-04T15:49:57.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1915 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9a44aa0e-cb1b-4355-b859-eafe88ea54b3 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52532025-06-04T15:49:58.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2fca387c-981b-417f-a102-399921eba3dc roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52542025-06-04T15:49:58.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2fca387c-981b-417f-a102-399921eba3dc resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52552025-06-04T15:49:58.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 6773 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2fca387c-981b-417f-a102-399921eba3dc response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52562025-06-04T15:49:59.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 79ff59d2-e4e7-4e33-b418-a1e12fd12f25 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52572025-06-04T15:49:59.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 79ff59d2-e4e7-4e33-b418-a1e12fd12f25 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52582025-06-04T15:49:59.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 79ff59d2-e4e7-4e33-b418-a1e12fd12f25 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52592025-06-04T15:49:59.953ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 479 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = 5bab974d-ce4b-4c8e-b7cc-1716732a92fe response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
52602025-06-04T15:50:00.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6d46e07c-19c0-46aa-9d1c-392d6f0cc1c8 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52612025-06-04T15:50:00.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6d46e07c-19c0-46aa-9d1c-392d6f0cc1c8 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52622025-06-04T15:50:00.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2986 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6d46e07c-19c0-46aa-9d1c-392d6f0cc1c8 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52632025-06-04T15:50:01.752ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
52642025-06-04T15:50:01.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52652025-06-04T15:50:01.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52662025-06-04T15:50:01.752ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
52672025-06-04T15:50:01.752ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52682025-06-04T15:50:01.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52692025-06-04T15:50:01.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52702025-06-04T15:50:01.754ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52712025-06-04T15:50:01.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52722025-06-04T15:50:01.757ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52732025-06-04T15:50:01.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52742025-06-04T15:50:01.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52752025-06-04T15:50:01.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52762025-06-04T15:50:01.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52772025-06-04T15:50:01.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52782025-06-04T15:50:01.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
52792025-06-04T15:50:01.763ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52802025-06-04T15:50:01.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52812025-06-04T15:50:01.774ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
52822025-06-04T15:50:01.774ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.319155ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
52832025-06-04T15:50:01.786ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.779405ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52842025-06-04T15:50:01.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6fba72fb-14e0-4488-b911-707902b3c657 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52852025-06-04T15:50:01.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6fba72fb-14e0-4488-b911-707902b3c657 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52862025-06-04T15:50:01.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1524 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6fba72fb-14e0-4488-b911-707902b3c657 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52872025-06-04T15:50:02.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d28dca37-3d06-46ad-be3d-b3ff8df2e73b roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52882025-06-04T15:50:02.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d28dca37-3d06-46ad-be3d-b3ff8df2e73b resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52892025-06-04T15:50:02.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d28dca37-3d06-46ad-be3d-b3ff8df2e73b response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52902025-06-04T15:50:03.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d45d5362-2351-4402-9415-b10263a0e6f7 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52912025-06-04T15:50:03.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d45d5362-2351-4402-9415-b10263a0e6f7 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52922025-06-04T15:50:03.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2656 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d45d5362-2351-4402-9415-b10263a0e6f7 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52932025-06-04T15:50:04.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5935e47a-6376-45a0-b38a-e01e34e456df roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52942025-06-04T15:50:04.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5935e47a-6376-45a0-b38a-e01e34e456df resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52952025-06-04T15:50:04.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2757 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5935e47a-6376-45a0-b38a-e01e34e456df response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52962025-06-04T15:50:05.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2b035319-1a7b-48f8-926f-cecc1f18d75b roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52972025-06-04T15:50:05.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2b035319-1a7b-48f8-926f-cecc1f18d75b resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52982025-06-04T15:50:05.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2b035319-1a7b-48f8-926f-cecc1f18d75b response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
52992025-06-04T15:50:06.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bad7c408-1f35-4f06-8f72-bcb5993febe5 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53002025-06-04T15:50:06.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bad7c408-1f35-4f06-8f72-bcb5993febe5 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53012025-06-04T15:50:06.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = bad7c408-1f35-4f06-8f72-bcb5993febe5 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53022025-06-04T15:50:07.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 96fc748e-6be3-4525-9027-1316acc84743 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53032025-06-04T15:50:07.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 96fc748e-6be3-4525-9027-1316acc84743 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53042025-06-04T15:50:07.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 96fc748e-6be3-4525-9027-1316acc84743 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53052025-06-04T15:50:08.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 675e8638-7441-48a7-977c-a44646316eff roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53062025-06-04T15:50:08.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 675e8638-7441-48a7-977c-a44646316eff resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53072025-06-04T15:50:08.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 675e8638-7441-48a7-977c-a44646316eff response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53082025-06-04T15:50:09.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9349e529-9a90-4d57-b469-adc7ddac69b9 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53092025-06-04T15:50:09.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9349e529-9a90-4d57-b469-adc7ddac69b9 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53102025-06-04T15:50:09.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 9349e529-9a90-4d57-b469-adc7ddac69b9 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53112025-06-04T15:50:09.953ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 584 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = e2c1a6c3-e349-4c7b-9faa-e71c4a5c4bed response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
53122025-06-04T15:50:10.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5f26c213-b35b-466a-85e8-02c68e6ffc2d roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53132025-06-04T15:50:10.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5f26c213-b35b-466a-85e8-02c68e6ffc2d resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53142025-06-04T15:50:10.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 5f26c213-b35b-466a-85e8-02c68e6ffc2d response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53152025-06-04T15:50:11.751ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
53162025-06-04T15:50:11.751ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53172025-06-04T15:50:11.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53182025-06-04T15:50:11.752ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
53192025-06-04T15:50:11.752ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53202025-06-04T15:50:11.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53212025-06-04T15:50:11.753ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53222025-06-04T15:50:11.754ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53232025-06-04T15:50:11.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53242025-06-04T15:50:11.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53252025-06-04T15:50:11.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53262025-06-04T15:50:11.756ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.127141ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53272025-06-04T15:50:11.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53282025-06-04T15:50:11.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53292025-06-04T15:50:11.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53302025-06-04T15:50:11.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53312025-06-04T15:50:11.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
53322025-06-04T15:50:11.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53332025-06-04T15:50:11.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53342025-06-04T15:50:11.772ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
53352025-06-04T15:50:11.772ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.991138ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
53362025-06-04T15:50:11.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 00c8755b-2020-46e8-b95d-bbcc03d526a4 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53372025-06-04T15:50:11.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 00c8755b-2020-46e8-b95d-bbcc03d526a4 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53382025-06-04T15:50:11.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 00c8755b-2020-46e8-b95d-bbcc03d526a4 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53392025-06-04T15:50:12.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 62e4de25-d924-41d8-9376-e8ee24ed2412 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53402025-06-04T15:50:12.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 62e4de25-d924-41d8-9376-e8ee24ed2412 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53412025-06-04T15:50:12.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 62e4de25-d924-41d8-9376-e8ee24ed2412 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53422025-06-04T15:50:13.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7a252624-c68a-4ccb-9764-bf4b797b5a9a roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53432025-06-04T15:50:13.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7a252624-c68a-4ccb-9764-bf4b797b5a9a resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53442025-06-04T15:50:13.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2343 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 7a252624-c68a-4ccb-9764-bf4b797b5a9a response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53452025-06-04T15:50:14.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 211dcfa3-2893-485f-a22b-d02b1a4a3cb3 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53462025-06-04T15:50:14.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 211dcfa3-2893-485f-a22b-d02b1a4a3cb3 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53472025-06-04T15:50:14.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 211dcfa3-2893-485f-a22b-d02b1a4a3cb3 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53482025-06-04T15:50:16.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8fb48410-3bbc-47a2-9f53-9abb72b0596d roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53492025-06-04T15:50:16.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8fb48410-3bbc-47a2-9f53-9abb72b0596d resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53502025-06-04T15:50:16.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8fb48410-3bbc-47a2-9f53-9abb72b0596d response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53512025-06-04T15:50:17.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 43c3f3fc-84e8-44f8-96a0-00d6a230541b roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53522025-06-04T15:50:17.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 43c3f3fc-84e8-44f8-96a0-00d6a230541b resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53532025-06-04T15:50:17.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2819 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 43c3f3fc-84e8-44f8-96a0-00d6a230541b response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53542025-06-04T15:50:18.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = c77afa7b-43e9-4f5e-b16b-d3de50d5c0b5 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53552025-06-04T15:50:18.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = c77afa7b-43e9-4f5e-b16b-d3de50d5c0b5 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53562025-06-04T15:50:18.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2609 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = c77afa7b-43e9-4f5e-b16b-d3de50d5c0b5 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53572025-06-04T15:50:19.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8691908e-843b-468e-9c45-75e46197ac65 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53582025-06-04T15:50:19.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8691908e-843b-468e-9c45-75e46197ac65 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53592025-06-04T15:50:19.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2772 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8691908e-843b-468e-9c45-75e46197ac65 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53602025-06-04T15:50:19.953ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 512 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = e3ca8cf6-39d0-4764-9de8-9e23a0dcc0be response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
53612025-06-04T15:50:20.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4524b779-1ed2-4d6f-94bc-ac4937b5847f roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53622025-06-04T15:50:20.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4524b779-1ed2-4d6f-94bc-ac4937b5847f resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53632025-06-04T15:50:20.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2596 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4524b779-1ed2-4d6f-94bc-ac4937b5847f response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53642025-06-04T15:50:21.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 244bd452-87d7-4378-8144-7f943e43d32a roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53652025-06-04T15:50:21.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 244bd452-87d7-4378-8144-7f943e43d32a resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53662025-06-04T15:50:21.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 244bd452-87d7-4378-8144-7f943e43d32a response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
53672025-06-04T15:50:21.750ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
53682025-06-04T15:50:21.750ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
53692025-06-04T15:50:21.750ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
53702025-06-04T15:50:21.750ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53712025-06-04T15:50:21.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
53722025-06-04T15:50:21.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53732025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
53742025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
53752025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53762025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
53772025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53782025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53792025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
53802025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53812025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
53822025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53832025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
53842025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 30 reason = Timeout
53852025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53862025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
53872025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
53882025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53892025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
53902025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
53912025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53922025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53932025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
53942025-06-04T15:50:21.752ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
53952025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
53962025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53972025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53982025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53992025-06-04T15:50:21.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54002025-06-04T15:50:21.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
54012025-06-04T15:50:21.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54022025-06-04T15:50:21.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54032025-06-04T15:50:21.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54042025-06-04T15:50:21.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54052025-06-04T15:50:21.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54062025-06-04T15:50:21.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54072025-06-04T15:50:21.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54082025-06-04T15:50:21.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54092025-06-04T15:50:21.753ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2189, tv_nsec: 891137549 } })
54102025-06-04T15:50:21.753ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2189, tv_nsec: 891177350 } })
54112025-06-04T15:50:21.753ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
54122025-06-04T15:50:21.754ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
54132025-06-04T15:50:21.755ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54142025-06-04T15:50:21.755ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54152025-06-04T15:50:21.755ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54162025-06-04T15:50:21.756ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.579464ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
54172025-06-04T15:50:21.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54182025-06-04T15:50:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54192025-06-04T15:50:21.758ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54202025-06-04T15:50:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54212025-06-04T15:50:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54222025-06-04T15:50:21.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54232025-06-04T15:50:21.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54242025-06-04T15:50:21.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
54252025-06-04T15:50:21.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
54262025-06-04T15:50:21.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
54272025-06-04T15:50:21.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54282025-06-04T15:50:21.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54292025-06-04T15:50:21.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
54302025-06-04T15:50:21.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
54312025-06-04T15:50:21.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
54322025-06-04T15:50:21.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
54332025-06-04T15:50:21.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54342025-06-04T15:50:21.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
54352025-06-04T15:50:21.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54362025-06-04T15:50:21.763ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54372025-06-04T15:50:21.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54382025-06-04T15:50:21.764ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54392025-06-04T15:50:21.765ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 30 reason = Timeout
54402025-06-04T15:50:21.765ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
54412025-06-04T15:50:21.765ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54422025-06-04T15:50:21.765ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
54432025-06-04T15:50:21.765ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54442025-06-04T15:50:21.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
54452025-06-04T15:50:21.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54462025-06-04T15:50:21.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54472025-06-04T15:50:21.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54482025-06-04T15:50:21.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54492025-06-04T15:50:21.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54502025-06-04T15:50:21.767ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54512025-06-04T15:50:21.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54522025-06-04T15:50:21.767ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54532025-06-04T15:50:21.767ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54542025-06-04T15:50:21.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54552025-06-04T15:50:21.767ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.43993ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54562025-06-04T15:50:21.769ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54572025-06-04T15:50:21.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54582025-06-04T15:50:21.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54592025-06-04T15:50:21.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54602025-06-04T15:50:21.774ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2189, tv_nsec: 911637061 } })
54612025-06-04T15:50:21.774ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
54622025-06-04T15:50:21.801ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54632025-06-04T15:50:21.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54642025-06-04T15:50:21.804ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54652025-06-04T15:50:21.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54662025-06-04T15:50:21.805ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54672025-06-04T15:50:21.806ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54682025-06-04T15:50:21.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54692025-06-04T15:50:21.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
54702025-06-04T15:50:21.807ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
54712025-06-04T15:50:21.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
54722025-06-04T15:50:21.808ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54732025-06-04T15:50:21.811ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54742025-06-04T15:50:21.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54752025-06-04T15:50:21.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54762025-06-04T15:50:21.812ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54772025-06-04T15:50:21.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54782025-06-04T15:50:21.813ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.314393ms iteration = 30 status = {"errors":[],"finish_invoked_ok":[]}
54792025-06-04T15:50:21.814ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 61.499196ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54802025-06-04T15:50:21.814ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.434547ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
54812025-06-04T15:50:21.814ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54822025-06-04T15:50:21.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54832025-06-04T15:50:21.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54842025-06-04T15:50:21.816ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54852025-06-04T15:50:21.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54862025-06-04T15:50:21.817ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54872025-06-04T15:50:21.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54882025-06-04T15:50:21.818ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54892025-06-04T15:50:21.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54902025-06-04T15:50:21.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54912025-06-04T15:50:21.820ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
54922025-06-04T15:50:21.820ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 67.597251ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
54932025-06-04T15:50:21.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54942025-06-04T15:50:21.820ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54952025-06-04T15:50:21.822ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54962025-06-04T15:50:21.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54972025-06-04T15:50:21.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
54982025-06-04T15:50:21.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54992025-06-04T15:50:21.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55002025-06-04T15:50:21.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e751cd2d-7b1b-4ea0-8b5a-62525772a5f5, lookup_type: ById(e751cd2d-7b1b-4ea0-8b5a-62525772a5f5) } result = Ok(())
55012025-06-04T15:50:21.825ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55022025-06-04T15:50:21.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55032025-06-04T15:50:21.826ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 60.960879ms iteration = 30 status = {"errors":[],"requests_created_ok":[]}
55042025-06-04T15:50:21.826ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55052025-06-04T15:50:21.826ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
55062025-06-04T15:50:21.826ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55072025-06-04T15:50:21.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55082025-06-04T15:50:21.831ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 78.537716ms iteration = 30 status = 0
55092025-06-04T15:50:21.837ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
55102025-06-04T15:50:21.837ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.801842ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
55112025-06-04T15:50:21.844ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
55122025-06-04T15:50:21.844ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55132025-06-04T15:50:21.844ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e198707e-22d2-459f-a821-21e365d2a509", "content-length": "26", "date": "Wed, 04 Jun 2025 15:50:21 GMT"} })
55142025-06-04T15:50:21.844ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55152025-06-04T15:50:21.845ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55162025-06-04T15:50:21.845ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
55172025-06-04T15:50:21.845ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55182025-06-04T15:50:21.846ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1824ff8f-e309-4998-9db5-5b033573d00d", "content-length": "26", "date": "Wed, 04 Jun 2025 15:50:21 GMT"} })
55192025-06-04T15:50:21.846ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55202025-06-04T15:50:21.848ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55212025-06-04T15:50:21.854ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 92.972513ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55222025-06-04T15:50:21.854ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
55232025-06-04T15:50:21.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
55242025-06-04T15:50:21.874ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55252025-06-04T15:50:21.874ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
55262025-06-04T15:50:21.874ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 121.541885ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
55272025-06-04T15:50:21.877ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 zone_address = fd00:1122:3344:101::2
55282025-06-04T15:50:21.877ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55292025-06-04T15:50:21.877ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "33f0113e-8a55-4867-ac8e-4cc8bfd88e23", "content-length": "26", "date": "Wed, 04 Jun 2025 15:50:21 GMT"} })
55302025-06-04T15:50:21.877ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55312025-06-04T15:50:21.878ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
55322025-06-04T15:50:21.879ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55332025-06-04T15:50:21.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55342025-06-04T15:50:21.892ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55352025-06-04T15:50:21.894ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
55362025-06-04T15:50:21.894ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
55372025-06-04T15:50:21.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
55382025-06-04T15:50:21.895ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
55392025-06-04T15:50:21.895ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 143.350133ms iteration = 30 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
55402025-06-04T15:50:21.908ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55412025-06-04T15:50:21.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55422025-06-04T15:50:21.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 152.432394ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
55432025-06-04T15:50:21.923ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 171.356826ms iteration = 33 status = {"physical_disks_added":0}
55442025-06-04T15:50:21.947ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55452025-06-04T15:50:21.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55462025-06-04T15:50:21.949ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 198.756494ms iteration = 30 status = null
55472025-06-04T15:50:22.007ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55482025-06-04T15:50:22.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55492025-06-04T15:50:22.009ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55502025-06-04T15:50:22.011ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
55512025-06-04T15:50:22.011ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55522025-06-04T15:50:22.011ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1345fa4-84ca-430b-a05f-07bccd4e6789", "content-length": "372", "date": "Wed, 04 Jun 2025 15:50:21 GMT"} })
55532025-06-04T15:50:22.011ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55542025-06-04T15:50:22.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55552025-06-04T15:50:22.012ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55562025-06-04T15:50:22.012ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55572025-06-04T15:50:22.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55582025-06-04T15:50:22.025ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 275.457057ms iteration = 30 status = {}
55592025-06-04T15:50:22.030ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
55602025-06-04T15:50:22.030ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
55612025-06-04T15:50:22.031ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "27227c80-dda4-4f35-9390-9fa32c2f227b", "date": "Wed, 04 Jun 2025 15:50:21 GMT"} })
55622025-06-04T15:50:22.031ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55632025-06-04T15:50:22.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55642025-06-04T15:50:22.032ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55652025-06-04T15:50:22.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55662025-06-04T15:50:22.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55672025-06-04T15:50:22.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55682025-06-04T15:50:22.038ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
55692025-06-04T15:50:22.038ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55702025-06-04T15:50:22.039ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "430bb4ba-33fa-47d5-b5df-b7b36c5b8019", "date": "Wed, 04 Jun 2025 15:50:21 GMT"} })
55712025-06-04T15:50:22.041ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 288.591239ms iteration = 31 status = {}
55722025-06-04T15:50:22.047ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55732025-06-04T15:50:22.049ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55742025-06-04T15:50:22.049ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55752025-06-04T15:50:22.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55762025-06-04T15:50:22.092ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55772025-06-04T15:50:22.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55782025-06-04T15:50:22.094ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 8dbb977a-0cb9-4cf4-916b-4e19edd41b70, rack_id: 2302d566-cff7-41c0-b6e9-4f6ac6057661, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(aeecc71f-0b8d-4aaf-8e0e-04ee00063f7a) } rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0
55792025-06-04T15:50:22.094ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55802025-06-04T15:50:22.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55812025-06-04T15:50:22.106ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
55822025-06-04T15:50:22.106ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = aeecc71f-0b8d-4aaf-8e0e-04ee00063f7a
55832025-06-04T15:50:22.107ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
55842025-06-04T15:50:22.107ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
55852025-06-04T15:50:22.107ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55862025-06-04T15:50:22.107ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55872025-06-04T15:50:22.107ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55882025-06-04T15:50:22.107ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55892025-06-04T15:50:22.107ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55902025-06-04T15:50:22.107ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55912025-06-04T15:50:22.107ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
55922025-06-04T15:50:22.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55932025-06-04T15:50:22.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55942025-06-04T15:50:22.109ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0
55952025-06-04T15:50:22.109ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
55962025-06-04T15:50:22.144ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
55972025-06-04T15:50:22.219ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d7feda30-fd0e-4405-8943-0cfde21e4917", "date": "Wed, 04 Jun 2025 15:50:21 GMT"} })
55982025-06-04T15:50:22.219ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch = Switch0
55992025-06-04T15:50:22.219ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
56002025-06-04T15:50:22.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 24469c2c-01b2-40e3-ae63-7c651e6424a3 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56012025-06-04T15:50:22.220ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c975bac2-146d-4466-ab64-4802dba44baf", "content-length": "682", "date": "Wed, 04 Jun 2025 15:50:21 GMT"} })
56022025-06-04T15:50:22.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56032025-06-04T15:50:22.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 24469c2c-01b2-40e3-ae63-7c651e6424a3 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56042025-06-04T15:50:22.220ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "60e0b1d1-14e9-4216-90ef-caa29b74b562", "content-length": "691", "date": "Wed, 04 Jun 2025 15:50:21 GMT"} })
56052025-06-04T15:50:22.220ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
56062025-06-04T15:50:22.220ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
56072025-06-04T15:50:22.220ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
56082025-06-04T15:50:22.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56092025-06-04T15:50:22.221ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 469.139209ms iteration = 31 status = {}
56102025-06-04T15:50:22.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 24469c2c-01b2-40e3-ae63-7c651e6424a3 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56112025-06-04T15:50:22.224ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56122025-06-04T15:50:22.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56132025-06-04T15:50:22.227ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56142025-06-04T15:50:22.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56152025-06-04T15:50:22.229ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56162025-06-04T15:50:22.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56172025-06-04T15:50:22.236ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 483.487944ms iteration = 30 status = {}
56182025-06-04T15:50:23.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2b750752-42f1-4d01-9eb3-85b936a8d9f4 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56192025-06-04T15:50:23.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2b750752-42f1-4d01-9eb3-85b936a8d9f4 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56202025-06-04T15:50:23.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1773 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 2b750752-42f1-4d01-9eb3-85b936a8d9f4 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56212025-06-04T15:50:24.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = dd568175-56b5-450f-a010-e70345a5df50 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56222025-06-04T15:50:24.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = dd568175-56b5-450f-a010-e70345a5df50 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56232025-06-04T15:50:24.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2678 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = dd568175-56b5-450f-a010-e70345a5df50 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56242025-06-04T15:50:25.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 42af8430-1b79-469a-a094-6086ea198bdd roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56252025-06-04T15:50:25.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 42af8430-1b79-469a-a094-6086ea198bdd resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56262025-06-04T15:50:25.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 42af8430-1b79-469a-a094-6086ea198bdd response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56272025-06-04T15:50:26.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4a7ea042-8956-477e-9222-22ac3af8f33d roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56282025-06-04T15:50:26.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4a7ea042-8956-477e-9222-22ac3af8f33d resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56292025-06-04T15:50:26.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2480 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4a7ea042-8956-477e-9222-22ac3af8f33d response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56302025-06-04T15:50:27.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6a68cdb7-ffdf-4661-b7b5-20bfc15d05cc roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56312025-06-04T15:50:27.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6a68cdb7-ffdf-4661-b7b5-20bfc15d05cc resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56322025-06-04T15:50:27.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2877 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6a68cdb7-ffdf-4661-b7b5-20bfc15d05cc response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56332025-06-04T15:50:28.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d078e98e-9f60-4168-98d9-e422cb3cab72 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56342025-06-04T15:50:28.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d078e98e-9f60-4168-98d9-e422cb3cab72 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56352025-06-04T15:50:28.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d078e98e-9f60-4168-98d9-e422cb3cab72 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56362025-06-04T15:50:29.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 1cfad512-bf02-42b5-9ee8-7d005f083c97 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56372025-06-04T15:50:29.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 1cfad512-bf02-42b5-9ee8-7d005f083c97 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56382025-06-04T15:50:29.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2667 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 1cfad512-bf02-42b5-9ee8-7d005f083c97 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56392025-06-04T15:50:29.944ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:62784
56402025-06-04T15:50:29.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62784 req_id = 155475bb-812b-433a-a747-b9c173595e51 roles = RoleSet { roles: {} } uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?sort_by=id_ascending
56412025-06-04T15:50:29.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62784 req_id = 155475bb-812b-433a-a747-b9c173595e51 resource = Database result = Ok(()) uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?sort_by=id_ascending
56422025-06-04T15:50:29.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2502 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62784 req_id = 155475bb-812b-433a-a747-b9c173595e51 response_code = 200 uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?sort_by=id_ascending
56432025-06-04T15:50:29.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62784 req_id = 19896186-6f35-4d2f-a697-9ebf38545ee8 roles = RoleSet { roles: {} } uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzUxY2QyZC03YjFiLTRlYTAtOGI1YS02MjUyNTc3MmE1ZjUifX0%3D
56442025-06-04T15:50:29.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62784 req_id = 19896186-6f35-4d2f-a697-9ebf38545ee8 resource = Database result = Ok(()) uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzUxY2QyZC03YjFiLTRlYTAtOGI1YS02MjUyNTc3MmE1ZjUifX0%3D
56452025-06-04T15:50:29.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2771 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62784 req_id = 19896186-6f35-4d2f-a697-9ebf38545ee8 response_code = 200 uri = /metrics/collectors/93dd7779-b561-4a6e-a81b-f44350333434/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzUxY2QyZC03YjFiLTRlYTAtOGI1YS02MjUyNTc3MmE1ZjUifX0%3D
56462025-06-04T15:50:29.953ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 492 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = 7054e041-a017-42b8-910a-3720e09e4e5f response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
56472025-06-04T15:50:30.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f6ad676d-b504-498c-ae1a-b186e6fdf270 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56482025-06-04T15:50:30.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f6ad676d-b504-498c-ae1a-b186e6fdf270 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56492025-06-04T15:50:30.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2691 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f6ad676d-b504-498c-ae1a-b186e6fdf270 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56502025-06-04T15:50:31.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b60fe5ec-4cc3-4866-b99c-ec7bb359bbbe roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56512025-06-04T15:50:31.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b60fe5ec-4cc3-4866-b99c-ec7bb359bbbe resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56522025-06-04T15:50:31.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1616 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b60fe5ec-4cc3-4866-b99c-ec7bb359bbbe response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56532025-06-04T15:50:31.752ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
56542025-06-04T15:50:31.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56552025-06-04T15:50:31.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56562025-06-04T15:50:31.752ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
56572025-06-04T15:50:31.752ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56582025-06-04T15:50:31.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56592025-06-04T15:50:31.754ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56602025-06-04T15:50:31.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56612025-06-04T15:50:31.756ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.846697ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56622025-06-04T15:50:31.785ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56632025-06-04T15:50:31.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56642025-06-04T15:50:31.788ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56652025-06-04T15:50:31.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56662025-06-04T15:50:31.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56672025-06-04T15:50:31.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56682025-06-04T15:50:31.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56692025-06-04T15:50:31.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
56702025-06-04T15:50:31.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56712025-06-04T15:50:31.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56722025-06-04T15:50:31.805ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
56732025-06-04T15:50:31.805ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.247935ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
56742025-06-04T15:50:32.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3683a430-648b-466b-adfb-ad89cd9495c9 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56752025-06-04T15:50:32.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3683a430-648b-466b-adfb-ad89cd9495c9 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56762025-06-04T15:50:32.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2869 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 3683a430-648b-466b-adfb-ad89cd9495c9 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56772025-06-04T15:50:33.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 549d539f-eb52-4977-8ef0-a31387bb6297 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56782025-06-04T15:50:33.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 549d539f-eb52-4977-8ef0-a31387bb6297 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56792025-06-04T15:50:33.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 549d539f-eb52-4977-8ef0-a31387bb6297 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56802025-06-04T15:50:34.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4ad8ef99-7765-4fc0-88cc-0dc11333387b roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56812025-06-04T15:50:34.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4ad8ef99-7765-4fc0-88cc-0dc11333387b resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56822025-06-04T15:50:34.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 4ad8ef99-7765-4fc0-88cc-0dc11333387b response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56832025-06-04T15:50:35.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 26a794f4-0a56-4fcd-8482-6eb933c50cbd roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56842025-06-04T15:50:35.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 26a794f4-0a56-4fcd-8482-6eb933c50cbd resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56852025-06-04T15:50:35.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1907 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 26a794f4-0a56-4fcd-8482-6eb933c50cbd response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56862025-06-04T15:50:36.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 31cd3d3d-5509-43e7-916c-6a629a47bec8 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56872025-06-04T15:50:36.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 31cd3d3d-5509-43e7-916c-6a629a47bec8 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56882025-06-04T15:50:36.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 31cd3d3d-5509-43e7-916c-6a629a47bec8 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56892025-06-04T15:50:37.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 1330d42c-4ee0-4357-bb9f-c9d30e293606 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56902025-06-04T15:50:37.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 1330d42c-4ee0-4357-bb9f-c9d30e293606 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56912025-06-04T15:50:37.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2542 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 1330d42c-4ee0-4357-bb9f-c9d30e293606 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56922025-06-04T15:50:38.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 953c0d77-03d0-4e69-aada-49d76a3f3798 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56932025-06-04T15:50:38.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 953c0d77-03d0-4e69-aada-49d76a3f3798 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56942025-06-04T15:50:38.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2268 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 953c0d77-03d0-4e69-aada-49d76a3f3798 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56952025-06-04T15:50:39.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b3e70868-c516-4561-a48b-2b0490958ac7 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56962025-06-04T15:50:39.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b3e70868-c516-4561-a48b-2b0490958ac7 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56972025-06-04T15:50:39.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b3e70868-c516-4561-a48b-2b0490958ac7 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
56982025-06-04T15:50:39.954ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 526 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = bcf5a85a-da1e-40e0-a916-8d38f3f73111 response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
56992025-06-04T15:50:40.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 48008b5e-dc11-4459-975f-3ed9b4484f50 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57002025-06-04T15:50:40.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 48008b5e-dc11-4459-975f-3ed9b4484f50 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57012025-06-04T15:50:40.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1984 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 48008b5e-dc11-4459-975f-3ed9b4484f50 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57022025-06-04T15:50:41.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e418968d-9a7f-48a7-8a55-068d398bcf01 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57032025-06-04T15:50:41.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e418968d-9a7f-48a7-8a55-068d398bcf01 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57042025-06-04T15:50:41.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = e418968d-9a7f-48a7-8a55-068d398bcf01 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57052025-06-04T15:50:41.752ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
57062025-06-04T15:50:41.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57072025-06-04T15:50:41.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57082025-06-04T15:50:41.752ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
57092025-06-04T15:50:41.752ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57102025-06-04T15:50:41.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57112025-06-04T15:50:41.754ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57122025-06-04T15:50:41.755ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57132025-06-04T15:50:41.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57142025-06-04T15:50:41.757ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57152025-06-04T15:50:41.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57162025-06-04T15:50:41.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57172025-06-04T15:50:41.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57182025-06-04T15:50:41.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57192025-06-04T15:50:41.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57202025-06-04T15:50:41.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
57212025-06-04T15:50:41.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57222025-06-04T15:50:41.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57232025-06-04T15:50:41.776ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
57242025-06-04T15:50:41.776ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.526629ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
57252025-06-04T15:50:41.786ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.162298ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57262025-06-04T15:50:42.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8ed44185-1661-4c74-86b2-6c5516e4db4e roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57272025-06-04T15:50:42.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8ed44185-1661-4c74-86b2-6c5516e4db4e resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57282025-06-04T15:50:42.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8ed44185-1661-4c74-86b2-6c5516e4db4e response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57292025-06-04T15:50:43.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = efb0138e-5fb0-4b84-8ce2-10af1cbbfb84 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57302025-06-04T15:50:43.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = efb0138e-5fb0-4b84-8ce2-10af1cbbfb84 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57312025-06-04T15:50:43.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2527 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = efb0138e-5fb0-4b84-8ce2-10af1cbbfb84 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57322025-06-04T15:50:44.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d52b5201-7b3a-4533-9399-7370e7b5c9e8 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57332025-06-04T15:50:44.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d52b5201-7b3a-4533-9399-7370e7b5c9e8 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57342025-06-04T15:50:44.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = d52b5201-7b3a-4533-9399-7370e7b5c9e8 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57352025-06-04T15:50:45.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8c8b5517-1c6d-4023-867f-eb1327dc1666 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57362025-06-04T15:50:45.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8c8b5517-1c6d-4023-867f-eb1327dc1666 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57372025-06-04T15:50:45.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2642 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8c8b5517-1c6d-4023-867f-eb1327dc1666 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57382025-06-04T15:50:46.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 74f3173a-aa95-4a1c-91d4-bda74543204d roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57392025-06-04T15:50:46.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 74f3173a-aa95-4a1c-91d4-bda74543204d resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57402025-06-04T15:50:46.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2539 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 74f3173a-aa95-4a1c-91d4-bda74543204d response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57412025-06-04T15:50:47.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 542f3d02-727a-429a-9bf6-a5dd58d864e9 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57422025-06-04T15:50:47.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 542f3d02-727a-429a-9bf6-a5dd58d864e9 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57432025-06-04T15:50:47.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 542f3d02-727a-429a-9bf6-a5dd58d864e9 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57442025-06-04T15:50:48.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 32984ecc-7f7a-4327-aaaf-2f1c7bca804e roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57452025-06-04T15:50:48.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 32984ecc-7f7a-4327-aaaf-2f1c7bca804e resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57462025-06-04T15:50:48.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2575 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 32984ecc-7f7a-4327-aaaf-2f1c7bca804e response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57472025-06-04T15:50:49.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 57438dd2-97de-4d25-b5a2-6064434f3d6e roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57482025-06-04T15:50:49.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 57438dd2-97de-4d25-b5a2-6064434f3d6e resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57492025-06-04T15:50:49.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 57438dd2-97de-4d25-b5a2-6064434f3d6e response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57502025-06-04T15:50:49.953ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 563 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = 1d0358e0-bddf-4939-a3b6-637f752b5d89 response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
57512025-06-04T15:50:50.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 01c299cd-d1a3-4843-9177-d2dbebd4eb3f roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57522025-06-04T15:50:50.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 01c299cd-d1a3-4843-9177-d2dbebd4eb3f resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57532025-06-04T15:50:50.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2750 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 01c299cd-d1a3-4843-9177-d2dbebd4eb3f response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57542025-06-04T15:50:51.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f0be4a6b-d52c-4b86-a0f8-0ef353bb1ab8 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57552025-06-04T15:50:51.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f0be4a6b-d52c-4b86-a0f8-0ef353bb1ab8 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57562025-06-04T15:50:51.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = f0be4a6b-d52c-4b86-a0f8-0ef353bb1ab8 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
57572025-06-04T15:50:51.750ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 31 reason = Timeout
57582025-06-04T15:50:51.750ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
57592025-06-04T15:50:51.750ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
57602025-06-04T15:50:51.750ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
57612025-06-04T15:50:51.750ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57622025-06-04T15:50:51.750ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
57632025-06-04T15:50:51.750ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
57642025-06-04T15:50:51.750ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 16 reason = Timeout
57652025-06-04T15:50:51.750ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-04 15:40:51.750948595 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
57662025-06-04T15:50:51.751ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
57672025-06-04T15:50:51.751ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
57682025-06-04T15:50:51.751ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57692025-06-04T15:50:51.751ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
57702025-06-04T15:50:51.751ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 18 reason = Timeout
57712025-06-04T15:50:51.751ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 18 reason = Timeout
57722025-06-04T15:50:51.751ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
57732025-06-04T15:50:51.751ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 31 reason = Timeout
57742025-06-04T15:50:51.751ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57752025-06-04T15:50:51.751ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57762025-06-04T15:50:51.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
57772025-06-04T15:50:51.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57782025-06-04T15:50:51.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57792025-06-04T15:50:51.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
57802025-06-04T15:50:51.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57812025-06-04T15:50:51.751ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("74458287-879a-4471-829f-da352f40aff2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("84104d89-910f-45b9-adb6-d23a6d4f41d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("84104d89-910f-45b9-adb6-d23a6d4f41d6.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 2219, tv_nsec: 888629049 } })
57822025-06-04T15:50:51.751ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6d97642c-17fd-4803-bc28-7ad83219ce8c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("91bdae66-8e10-4892-9bfd-517dee32a9bd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e10264ea-c7fb-4742-9452-fa5e125ebf3d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e10264ea-c7fb-4742-9452-fa5e125ebf3d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 2219, tv_nsec: 888648599 } })
57832025-06-04T15:50:51.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57842025-06-04T15:50:51.751ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57852025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
57862025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.119803ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
57872025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 91 reason = Timeout
57882025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 31 reason = Timeout
57892025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 7 reason = Timeout
57902025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57912025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 31 reason = Timeout
57922025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
57932025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
57942025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
57952025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57962025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 31 reason = Timeout
57972025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 17 reason = Timeout
57982025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
57992025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.207014ms iteration = 16 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353"]}
58002025-06-04T15:50:51.752ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf
58012025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58022025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 16 reason = Timeout
58032025-06-04T15:50:51.752ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
58042025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 7 reason = Timeout
58052025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.14\u{b5}s iteration = 17 status = {"enabled":false,"target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf"}
58062025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
58072025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 31 reason = Timeout
58082025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58092025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58102025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58112025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58122025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
58132025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
58142025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
58152025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58162025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58172025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58182025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58192025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58202025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58212025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58222025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58232025-06-04T15:50:51.752ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58242025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58252025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58262025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
58272025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
58282025-06-04T15:50:51.753ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
58292025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
58302025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 91 reason = Timeout
58312025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58322025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58332025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58342025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58352025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 32 reason = Timeout
58362025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 16 reason = Timeout
58372025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58382025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 31 reason = Timeout
58392025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
58402025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 31 reason = Timeout
58412025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58422025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58432025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 4 reason = Timeout
58442025-06-04T15:50:51.753ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
58452025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58462025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58472025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58482025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
58492025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58502025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58512025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58522025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58532025-06-04T15:50:51.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
58542025-06-04T15:50:51.754ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58552025-06-04T15:50:51.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58562025-06-04T15:50:51.754ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2219, tv_nsec: 891634466 } })
58572025-06-04T15:50:51.754ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
58582025-06-04T15:50:51.755ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2219, tv_nsec: 892262023 } })
58592025-06-04T15:50:51.755ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
58602025-06-04T15:50:51.755ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58612025-06-04T15:50:51.756ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-04 15:40:51.750948595 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
58622025-06-04T15:50:51.756ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.076163ms iteration = 16 status = {"expiration":"2025-06-04T15:40:51.750948595Z","pruned":[]}
58632025-06-04T15:50:51.757ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58642025-06-04T15:50:51.757ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
58652025-06-04T15:50:51.757ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58662025-06-04T15:50:51.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58672025-06-04T15:50:51.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58682025-06-04T15:50:51.758ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.719722ms iteration = 31 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
58692025-06-04T15:50:51.759ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58702025-06-04T15:50:51.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 31 reason = Timeout
58712025-06-04T15:50:51.761ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 16 reason = Timeout
58722025-06-04T15:50:51.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58732025-06-04T15:50:51.761ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
58742025-06-04T15:50:51.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 31 reason = Timeout
58752025-06-04T15:50:51.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
58762025-06-04T15:50:51.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 31 reason = Timeout
58772025-06-04T15:50:51.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
58782025-06-04T15:50:51.761ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 4 reason = Timeout
58792025-06-04T15:50:51.761ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
58802025-06-04T15:50:51.761ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 31 reason = Timeout
58812025-06-04T15:50:51.761ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58822025-06-04T15:50:51.761ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 16 reason = Timeout
58832025-06-04T15:50:51.761ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
58842025-06-04T15:50:51.761ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58852025-06-04T15:50:51.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58862025-06-04T15:50:51.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
58872025-06-04T15:50:51.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
58882025-06-04T15:50:51.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58892025-06-04T15:50:51.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
58902025-06-04T15:50:51.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
58912025-06-04T15:50:51.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
58922025-06-04T15:50:51.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58932025-06-04T15:50:51.762ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58942025-06-04T15:50:51.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58952025-06-04T15:50:51.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
58962025-06-04T15:50:51.763ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
58972025-06-04T15:50:51.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
58982025-06-04T15:50:51.764ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58992025-06-04T15:50:51.764ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59002025-06-04T15:50:51.765ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59012025-06-04T15:50:51.765ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 31 reason = Timeout
59022025-06-04T15:50:51.765ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
59032025-06-04T15:50:51.765ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 16 reason = Timeout
59042025-06-04T15:50:51.765ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
59052025-06-04T15:50:51.765ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 16 reason = Timeout
59062025-06-04T15:50:51.765ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
59072025-06-04T15:50:51.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
59082025-06-04T15:50:51.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
59092025-06-04T15:50:51.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
59102025-06-04T15:50:51.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
59112025-06-04T15:50:51.767ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59122025-06-04T15:50:51.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59132025-06-04T15:50:51.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59142025-06-04T15:50:51.768ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59152025-06-04T15:50:51.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59162025-06-04T15:50:51.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
59172025-06-04T15:50:51.770ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59182025-06-04T15:50:51.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59192025-06-04T15:50:51.771ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59202025-06-04T15:50:51.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
59212025-06-04T15:50:51.773ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59222025-06-04T15:50:51.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59232025-06-04T15:50:51.774ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59242025-06-04T15:50:51.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
59252025-06-04T15:50:51.776ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59262025-06-04T15:50:51.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59272025-06-04T15:50:51.780ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59282025-06-04T15:50:51.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59292025-06-04T15:50:51.782ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59302025-06-04T15:50:51.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59312025-06-04T15:50:51.814ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59322025-06-04T15:50:51.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
59332025-06-04T15:50:51.817ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
59342025-06-04T15:50:51.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
59352025-06-04T15:50:51.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59362025-06-04T15:50:51.820ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59372025-06-04T15:50:51.820ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59382025-06-04T15:50:51.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
59392025-06-04T15:50:51.824ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
59402025-06-04T15:50:51.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
59412025-06-04T15:50:51.825ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
59422025-06-04T15:50:51.825ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
59432025-06-04T15:50:51.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
59442025-06-04T15:50:51.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
59452025-06-04T15:50:51.826ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59462025-06-04T15:50:51.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59472025-06-04T15:50:51.828ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
59482025-06-04T15:50:51.828ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
59492025-06-04T15:50:51.828ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
59502025-06-04T15:50:51.828ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59512025-06-04T15:50:51.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59522025-06-04T15:50:51.828ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
59532025-06-04T15:50:51.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
59542025-06-04T15:50:51.829ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 67.928975ms iteration = 16 status = {"errors":[],"found_port_ok":[]}
59552025-06-04T15:50:51.829ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59562025-06-04T15:50:51.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59572025-06-04T15:50:51.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59582025-06-04T15:50:51.834ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59592025-06-04T15:50:51.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59602025-06-04T15:50:51.838ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59612025-06-04T15:50:51.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59622025-06-04T15:50:51.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59632025-06-04T15:50:51.840ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
59642025-06-04T15:50:51.840ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 74.728838ms iteration = 16 status = {"by_rx":{},"error":null}
59652025-06-04T15:50:51.841ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59662025-06-04T15:50:51.842ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e751cd2d-7b1b-4ea0-8b5a-62525772a5f5.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 2219, tv_nsec: 979552587 } })
59672025-06-04T15:50:51.842ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
59682025-06-04T15:50:51.843ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59692025-06-04T15:50:51.844ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59702025-06-04T15:50:51.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59712025-06-04T15:50:51.844ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59722025-06-04T15:50:51.844ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
59732025-06-04T15:50:51.844ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59742025-06-04T15:50:51.844ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59752025-06-04T15:50:51.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59762025-06-04T15:50:51.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59772025-06-04T15:50:51.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
59782025-06-04T15:50:51.846ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59792025-06-04T15:50:51.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
59802025-06-04T15:50:51.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
59812025-06-04T15:50:51.846ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59822025-06-04T15:50:51.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59832025-06-04T15:50:51.846ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59842025-06-04T15:50:51.847ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59852025-06-04T15:50:51.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
59862025-06-04T15:50:51.849ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59872025-06-04T15:50:51.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59882025-06-04T15:50:51.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59892025-06-04T15:50:51.852ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
59902025-06-04T15:50:51.852ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
59912025-06-04T15:50:51.852ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 91.251852ms iteration = 16 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
59922025-06-04T15:50:51.853ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 91.785328ms iteration = 31 status = {"errors":[],"finish_invoked_ok":[]}
59932025-06-04T15:50:51.853ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59942025-06-04T15:50:51.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59952025-06-04T15:50:51.853ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
59962025-06-04T15:50:51.853ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
59972025-06-04T15:50:51.853ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
59982025-06-04T15:50:51.854ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59992025-06-04T15:50:51.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
60002025-06-04T15:50:51.854ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60012025-06-04T15:50:51.854ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60022025-06-04T15:50:51.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60032025-06-04T15:50:51.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60042025-06-04T15:50:51.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60052025-06-04T15:50:51.855ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60062025-06-04T15:50:51.855ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
60072025-06-04T15:50:51.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
60082025-06-04T15:50:51.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 95.974381ms iteration = 31 status = {"errors":[],"garbage_collect_requested":[]}
60092025-06-04T15:50:51.857ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
60102025-06-04T15:50:51.857ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
60112025-06-04T15:50:51.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
60122025-06-04T15:50:51.858ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
60132025-06-04T15:50:51.858ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60142025-06-04T15:50:51.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60152025-06-04T15:50:51.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60162025-06-04T15:50:51.859ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60172025-06-04T15:50:51.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60182025-06-04T15:50:51.860ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60192025-06-04T15:50:51.860ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60202025-06-04T15:50:51.862ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
60212025-06-04T15:50:51.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
60222025-06-04T15:50:51.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
60232025-06-04T15:50:51.863ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
60242025-06-04T15:50:51.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
60252025-06-04T15:50:51.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
60262025-06-04T15:50:51.864ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60272025-06-04T15:50:51.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60282025-06-04T15:50:51.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
60292025-06-04T15:50:51.865ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60302025-06-04T15:50:51.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60312025-06-04T15:50:51.866ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60322025-06-04T15:50:51.867ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 114.345886ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
60332025-06-04T15:50:51.868ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60342025-06-04T15:50:51.868ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60352025-06-04T15:50:51.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60362025-06-04T15:50:51.871ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 118.932652ms iteration = 7 status = {"nsuccess":5}
60372025-06-04T15:50:51.871ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60382025-06-04T15:50:51.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60392025-06-04T15:50:51.879ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 113.142731ms iteration = 16 status = {"dispatched":[],"errors":[],"glob_version":"147.0.0","globs_reprocessed":{},"no_receivers":[]}
60402025-06-04T15:50:51.885ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
60412025-06-04T15:50:51.885ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
60422025-06-04T15:50:51.885ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 133.601692ms iteration = 16 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
60432025-06-04T15:50:51.897ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 131.446566ms iteration = 31 status = {"errors":[],"requests_created_ok":[]}
60442025-06-04T15:50:51.900ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
60452025-06-04T15:50:51.900ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 148.404664ms iteration = 91 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
60462025-06-04T15:50:51.901ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
60472025-06-04T15:50:51.901ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60482025-06-04T15:50:51.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60492025-06-04T15:50:51.903ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60502025-06-04T15:50:51.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60512025-06-04T15:50:51.905ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60522025-06-04T15:50:51.910ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
60532025-06-04T15:50:51.910ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60542025-06-04T15:50:51.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60552025-06-04T15:50:51.911ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
60562025-06-04T15:50:51.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
60572025-06-04T15:50:51.912ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60582025-06-04T15:50:51.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60592025-06-04T15:50:51.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60602025-06-04T15:50:51.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60612025-06-04T15:50:51.913ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60622025-06-04T15:50:51.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60632025-06-04T15:50:51.914ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60642025-06-04T15:50:51.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60652025-06-04T15:50:51.915ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
60662025-06-04T15:50:51.915ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
60672025-06-04T15:50:51.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
60682025-06-04T15:50:51.916ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
60692025-06-04T15:50:51.916ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60702025-06-04T15:50:51.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60712025-06-04T15:50:51.918ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60722025-06-04T15:50:51.918ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60732025-06-04T15:50:51.919ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60742025-06-04T15:50:51.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60752025-06-04T15:50:51.920ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60762025-06-04T15:50:51.920ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60772025-06-04T15:50:51.923ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
60782025-06-04T15:50:51.923ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
60792025-06-04T15:50:51.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
60802025-06-04T15:50:51.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
60812025-06-04T15:50:51.924ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60822025-06-04T15:50:51.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60832025-06-04T15:50:51.924ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60842025-06-04T15:50:51.924ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60852025-06-04T15:50:51.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e751cd2d-7b1b-4ea0-8b5a-62525772a5f5, lookup_type: ById(e751cd2d-7b1b-4ea0-8b5a-62525772a5f5) } result = Ok(())
60862025-06-04T15:50:51.924ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60872025-06-04T15:50:51.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60882025-06-04T15:50:51.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60892025-06-04T15:50:51.928ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
60902025-06-04T15:50:51.928ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 176.192626ms iteration = 31 status = 0
60912025-06-04T15:50:51.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
60922025-06-04T15:50:51.931ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60932025-06-04T15:50:51.931ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60942025-06-04T15:50:51.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60952025-06-04T15:50:51.932ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 171.108884ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
60962025-06-04T15:50:51.933ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60972025-06-04T15:50:51.933ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
60982025-06-04T15:50:51.933ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
60992025-06-04T15:50:51.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61002025-06-04T15:50:51.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
61012025-06-04T15:50:51.934ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
61022025-06-04T15:50:51.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
61032025-06-04T15:50:51.936ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61042025-06-04T15:50:51.936ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61052025-06-04T15:50:51.937ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61062025-06-04T15:50:51.937ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
61072025-06-04T15:50:51.937ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61082025-06-04T15:50:51.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61092025-06-04T15:50:51.938ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61102025-06-04T15:50:51.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61112025-06-04T15:50:51.938ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
61122025-06-04T15:50:51.938ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
61132025-06-04T15:50:51.938ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61142025-06-04T15:50:51.938ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 186.708145ms iteration = 31 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
61152025-06-04T15:50:51.938ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
61162025-06-04T15:50:51.938ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
61172025-06-04T15:50:51.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61182025-06-04T15:50:51.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
61192025-06-04T15:50:51.939ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61202025-06-04T15:50:51.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61212025-06-04T15:50:51.939ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
61222025-06-04T15:50:51.939ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 186.563084ms iteration = 31 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
61232025-06-04T15:50:51.940ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 187.278032ms iteration = 91 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61242025-06-04T15:50:51.940ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
61252025-06-04T15:50:51.940ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 3a2843d7-1e1c-47e4-9521-1eb938c0106b dns_zone_name = oxide.test found_so_far = 0 version = 2
61262025-06-04T15:50:51.940ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61272025-06-04T15:50:51.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61282025-06-04T15:50:51.941ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61292025-06-04T15:50:51.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61302025-06-04T15:50:51.942ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61312025-06-04T15:50:51.942ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
61322025-06-04T15:50:51.942ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 190.766955ms iteration = 7 status = {"blueprint_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","inventory_collection_id":"328f619d-ccbe-4d07-bfb3-837f64d406d2","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
61332025-06-04T15:50:51.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61342025-06-04T15:50:51.943ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61352025-06-04T15:50:51.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61362025-06-04T15:50:51.945ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61372025-06-04T15:50:51.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61382025-06-04T15:50:51.958ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61392025-06-04T15:50:51.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61402025-06-04T15:50:51.962ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61412025-06-04T15:50:51.968ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
61422025-06-04T15:50:51.968ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61432025-06-04T15:50:51.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61442025-06-04T15:50:51.970ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
61452025-06-04T15:50:51.970ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 4b1484ba-d395-4f36-93b6-c834b9680ee9 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
61462025-06-04T15:50:51.970ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61472025-06-04T15:50:51.970ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61482025-06-04T15:50:51.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61492025-06-04T15:50:51.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61502025-06-04T15:50:51.973ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61512025-06-04T15:50:51.973ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61522025-06-04T15:50:51.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61532025-06-04T15:50:51.977ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
61542025-06-04T15:50:51.978ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61552025-06-04T15:50:51.978ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61562025-06-04T15:50:51.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61572025-06-04T15:50:51.981ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61582025-06-04T15:50:51.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61592025-06-04T15:50:51.988ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 226.469845ms iteration = 31 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
61602025-06-04T15:50:51.989ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61612025-06-04T15:50:51.989ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
61622025-06-04T15:50:51.989ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 236.521129ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
61632025-06-04T15:50:51.995ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61642025-06-04T15:50:51.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61652025-06-04T15:50:51.998ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61662025-06-04T15:50:51.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61672025-06-04T15:50:51.999ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-04T15:35:43.043689Z, time_modified: 2025-06-04T15:35:43.043689Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: bcca9629-d8e0-4351-a4fb-8029b18eb633, db_silo: Silo { identity: SiloIdentity { id: bcca9629-d8e0-4351-a4fb-8029b18eb633, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-04T15:35:55.573183Z, time_modified: 2025-06-04T15:35:55.573183Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a49af7a2313337b84535ddab02a38b7781b3f7789d0df44311ad2658fa92170d" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: bcca9629-d8e0-4351-a4fb-8029b18eb633, db_silo: Silo { identity: SiloIdentity { id: bcca9629-d8e0-4351-a4fb-8029b18eb633, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-04T15:35:55.573183Z, time_modified: 2025-06-04T15:35:55.573183Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "a49af7a2313337b84535ddab02a38b7781b3f7789d0df44311ad2658fa92170d" }] }) }
61682025-06-04T15:50:51.999ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 248.238382ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"bcca9629-d8e0-4351-a4fb-8029b18eb633","tls_certs":["a49af7a2313337b84535ddab02a38b7781b3f7789d0df44311ad2658fa92170d"]}},"default_endpoint":{"silo_id":"bcca9629-d8e0-4351-a4fb-8029b18eb633","tls_certs":["a49af7a2313337b84535ddab02a38b7781b3f7789d0df44311ad2658fa92170d"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
61692025-06-04T15:50:52.032ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
61702025-06-04T15:50:52.033ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61712025-06-04T15:50:52.033ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a6e18d9-7eef-487b-ad19-0d9c9303f5ea", "content-length": "26", "date": "Wed, 04 Jun 2025 15:50:52 GMT"} })
61722025-06-04T15:50:52.033ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61732025-06-04T15:50:52.035ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61742025-06-04T15:50:52.044ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 292.277024ms iteration = 34 status = {"physical_disks_added":0}
61752025-06-04T15:50:52.067ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
61762025-06-04T15:50:52.067ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 313.9622ms iteration = 16 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
61772025-06-04T15:50:52.072ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
61782025-06-04T15:50:52.072ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61792025-06-04T15:50:52.072ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b7a19af-fe9a-43df-9fba-b1511957ca45", "content-length": "26", "date": "Wed, 04 Jun 2025 15:50:52 GMT"} })
61802025-06-04T15:50:52.072ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61812025-06-04T15:50:52.073ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61822025-06-04T15:50:52.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61832025-06-04T15:50:52.074ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61842025-06-04T15:50:52.093ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
61852025-06-04T15:50:52.199ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 zone_address = fd00:1122:3344:101::2
61862025-06-04T15:50:52.199ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61872025-06-04T15:50:52.200ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b7112c6-14fc-4d52-9ff4-00bbd67af7c6", "content-length": "26", "date": "Wed, 04 Jun 2025 15:50:52 GMT"} })
61882025-06-04T15:50:52.200ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61892025-06-04T15:50:52.201ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
61902025-06-04T15:50:52.309ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
61912025-06-04T15:50:52.309ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61922025-06-04T15:50:52.309ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc530b64-1a00-4d8f-ba0e-4d99b3aada5d", "content-length": "372", "date": "Wed, 04 Jun 2025 15:50:51 GMT"} })
61932025-06-04T15:50:52.309ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61942025-06-04T15:50:52.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61952025-06-04T15:50:52.320ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
61962025-06-04T15:50:52.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
61972025-06-04T15:50:52.323ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61982025-06-04T15:50:52.324ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61992025-06-04T15:50:52.324ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 4b1484ba-d395-4f36-93b6-c834b9680ee9 dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
62002025-06-04T15:50:52.324ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
62012025-06-04T15:50:52.324ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-04 15:35:53.349408 UTC dns_group = internal generation = 1
62022025-06-04T15:50:52.324ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 573.37481ms iteration = 16 status = {"generation":1}
62032025-06-04T15:50:52.324ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 3a2843d7-1e1c-47e4-9521-1eb938c0106b dns_zone_name = oxide.test found_so_far = 4 version = 2
62042025-06-04T15:50:52.324ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
62052025-06-04T15:50:52.324ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-04 15:35:55.637968 UTC dns_group = external generation = 2
62062025-06-04T15:50:52.324ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 573.705074ms iteration = 16 status = {"generation":2}
62072025-06-04T15:50:52.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62082025-06-04T15:50:52.326ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62092025-06-04T15:50:52.326ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62102025-06-04T15:50:52.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62112025-06-04T15:50:52.328ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62122025-06-04T15:50:52.330ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62132025-06-04T15:50:52.330ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62142025-06-04T15:50:52.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62152025-06-04T15:50:52.335ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
62162025-06-04T15:50:52.336ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "3f8204e7-5c43-4683-94ac-9e4e595d8666", "date": "Wed, 04 Jun 2025 15:50:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
62172025-06-04T15:50:52.336ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
62182025-06-04T15:50:52.338ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a64f6971-13a4-40e8-b48d-81c6acfabaab", "date": "Wed, 04 Jun 2025 15:50:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
62192025-06-04T15:50:52.338ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
62202025-06-04T15:50:52.340ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "72cc7121-3069-48be-9589-ee4035148d92", "date": "Wed, 04 Jun 2025 15:50:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
62212025-06-04T15:50:52.340ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
62222025-06-04T15:50:52.342ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353] }
62232025-06-04T15:50:52.342ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 591.24553ms iteration = 18 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
62242025-06-04T15:50:52.365ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62252025-06-04T15:50:52.365ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 614.991172ms iteration = 31 status = {}
62262025-06-04T15:50:52.367ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62272025-06-04T15:50:52.367ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
62282025-06-04T15:50:52.367ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
62292025-06-04T15:50:52.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62302025-06-04T15:50:52.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
62312025-06-04T15:50:52.369ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
62322025-06-04T15:50:52.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
62332025-06-04T15:50:52.371ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62342025-06-04T15:50:52.373ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
62352025-06-04T15:50:52.373ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
62362025-06-04T15:50:52.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
62372025-06-04T15:50:52.374ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
62382025-06-04T15:50:52.374ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "14d22647-f24b-4115-a9f6-c270135290a2", "date": "Wed, 04 Jun 2025 15:50:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62392025-06-04T15:50:52.374ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62402025-06-04T15:50:52.375ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/artifacts-config
62412025-06-04T15:50:52.379ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts-config", status: 204, headers: {"x-request-id": "a31e00d4-49cf-4e54-b894-0d74b58e2ea1", "date": "Wed, 04 Jun 2025 15:50:52 GMT"} })
62422025-06-04T15:50:52.379ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
62432025-06-04T15:50:52.379ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f72bf68-012f-4a68-a383-e7fa46628c63", "content-length": "26", "date": "Wed, 04 Jun 2025 15:50:51 GMT"} })
62442025-06-04T15:50:52.379ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:673 sled = http://[fd00:1122:3344:101::1]:12345
62452025-06-04T15:50:52.380ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "829a567e-ac21-467d-b12b-54bc90e950a5", "date": "Wed, 04 Jun 2025 15:50:51 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62462025-06-04T15:50:52.380ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62472025-06-04T15:50:52.381ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 619.875682ms iteration = 4 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":4,"put_config_err":0,"put_config_ok":4,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"e751cd2d-7b1b-4ea0-8b5a-62525772a5f5","time":"2025-06-04T15:35:52.240654407Z"},{"operation":"list","target_sled":"e751cd2d-7b1b-4ea0-8b5a-62525772a5f5","time":"2025-06-04T15:35:52.240920310Z"},{"generation":1,"operation":"put_config","target_sled":"e751cd2d-7b1b-4ea0-8b5a-62525772a5f5","time":"2025-06-04T15:40:52.448226065Z"},{"operation":"list","target_sled":"e751cd2d-7b1b-4ea0-8b5a-62525772a5f5","time":"2025-06-04T15:40:52.448437388Z"},{"generation":1,"operation":"put_config","target_sled":"e751cd2d-7b1b-4ea0-8b5a-62525772a5f5","time":"2025-06-04T15:45:52.364559805Z"},{"operation":"list","target_sled":"e751cd2d-7b1b-4ea0-8b5a-62525772a5f5","time":"2025-06-04T15:45:52.364815925Z"},{"generation":1,"operation":"put_config","target_sled":"e751cd2d-7b1b-4ea0-8b5a-62525772a5f5","time":"2025-06-04T15:50:52.379361882Z"},{"operation":"list","target_sled":"e751cd2d-7b1b-4ea0-8b5a-62525772a5f5","time":"2025-06-04T15:50:52.379630005Z"}]}
62482025-06-04T15:50:52.381ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
62492025-06-04T15:50:52.381ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
62502025-06-04T15:50:52.382ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7285ad48-68b3-4940-8bc8-6da6908c3128", "date": "Wed, 04 Jun 2025 15:50:52 GMT"} })
62512025-06-04T15:50:52.382ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62522025-06-04T15:50:52.382ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62532025-06-04T15:50:52.382ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 631.10164ms iteration = 18 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
62542025-06-04T15:50:52.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62552025-06-04T15:50:52.384ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62562025-06-04T15:50:52.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62572025-06-04T15:50:52.388ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62582025-06-04T15:50:52.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62592025-06-04T15:50:52.391ZINFOnexus (BackgroundTasks): VPC route manager sled e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
62602025-06-04T15:50:52.391ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62612025-06-04T15:50:52.391ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5e659c29-c985-4baa-ad1d-e31124650195", "date": "Wed, 04 Jun 2025 15:50:52 GMT"} })
62622025-06-04T15:50:52.391ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62632025-06-04T15:50:52.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62642025-06-04T15:50:52.393ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 640.01761ms iteration = 32 status = {}
62652025-06-04T15:50:52.393ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 642.897934ms iteration = 31 status = null
62662025-06-04T15:50:52.407ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62672025-06-04T15:50:52.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62682025-06-04T15:50:52.454ZDEBGnexus (BackgroundTasks): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
62692025-06-04T15:50:52.455ZDEBGnexus (BackgroundTasks): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "02a1c04b-e936-483a-8c9a-51f082c66dc9", "content-length": "691", "date": "Wed, 04 Jun 2025 15:50:52 GMT"} })
62702025-06-04T15:50:52.455ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
62712025-06-04T15:50:52.455ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
62722025-06-04T15:50:52.455ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
62732025-06-04T15:50:52.456ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62742025-06-04T15:50:52.456ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 703.182676ms iteration = 32 status = {}
62752025-06-04T15:50:52.459ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
62762025-06-04T15:50:52.459ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62772025-06-04T15:50:52.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62782025-06-04T15:50:52.461ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62792025-06-04T15:50:52.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62802025-06-04T15:50:52.463ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62812025-06-04T15:50:52.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62822025-06-04T15:50:52.464ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62832025-06-04T15:50:52.468ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
62842025-06-04T15:50:52.468ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62852025-06-04T15:50:52.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62862025-06-04T15:50:52.472ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62872025-06-04T15:50:52.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62882025-06-04T15:50:52.473ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62892025-06-04T15:50:52.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62902025-06-04T15:50:52.474ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62912025-06-04T15:50:52.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62922025-06-04T15:50:52.475ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62932025-06-04T15:50:52.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62942025-06-04T15:50:52.476ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 8dbb977a-0cb9-4cf4-916b-4e19edd41b70, rack_id: 2302d566-cff7-41c0-b6e9-4f6ac6057661, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(aeecc71f-0b8d-4aaf-8e0e-04ee00063f7a) } rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0
62952025-06-04T15:50:52.476ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62962025-06-04T15:50:52.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62972025-06-04T15:50:52.477ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62982025-06-04T15:50:52.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62992025-06-04T15:50:52.479ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63002025-06-04T15:50:52.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63012025-06-04T15:50:52.481ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63022025-06-04T15:50:52.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63032025-06-04T15:50:52.483ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63042025-06-04T15:50:52.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63052025-06-04T15:50:52.484ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63062025-06-04T15:50:52.488ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
63072025-06-04T15:50:52.488ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63082025-06-04T15:50:52.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63092025-06-04T15:50:52.488ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
63102025-06-04T15:50:52.488ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = aeecc71f-0b8d-4aaf-8e0e-04ee00063f7a
63112025-06-04T15:50:52.488ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
63122025-06-04T15:50:52.488ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63132025-06-04T15:50:52.488ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63142025-06-04T15:50:52.488ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63152025-06-04T15:50:52.488ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63162025-06-04T15:50:52.488ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63172025-06-04T15:50:52.488ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63182025-06-04T15:50:52.488ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63192025-06-04T15:50:52.489ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661
63202025-06-04T15:50:52.489ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63212025-06-04T15:50:52.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63222025-06-04T15:50:52.489ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63232025-06-04T15:50:52.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63242025-06-04T15:50:52.490ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63252025-06-04T15:50:52.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63262025-06-04T15:50:52.491ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch_location = Switch0
63272025-06-04T15:50:52.491ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
63282025-06-04T15:50:52.492ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63292025-06-04T15:50:52.496ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
63302025-06-04T15:50:52.496ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63312025-06-04T15:50:52.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63322025-06-04T15:50:52.501ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 389072d3-5513-4141-a60f-4942292c83e8, kind: Service { id: 84104d89-910f-45b9-adb6-d23a6d4f41d6 }, name: Name("external-dns-84104d89-910f-45b9-adb6-d23a6d4f41d6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 25])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fff3c2f8-b8b3-4438-8046-e8a2a3a5c986, kind: Service { id: 74458287-879a-4471-829f-da352f40aff2 }, name: Name("external-dns-74458287-879a-4471-829f-da352f40aff2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 57])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 10b0c705-4d8e-4d51-bb19-677beab0068d, kind: Service { id: 543f2cf1-864a-4cc8-86a9-4279c52d053c }, name: Name("nexus-543f2cf1-864a-4cc8-86a9-4279c52d053c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 189])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d8351219-a147-42d5-b119-bf9346e4a16f, kind: Service { id: 753f2fd8-42b8-4240-8646-4c4baf5591e2 }, name: Name("nexus-753f2fd8-42b8-4240-8646-4c4baf5591e2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e43cef14-db85-4ea2-b9ec-0b71960369e3, kind: Service { id: 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c }, name: Name("nexus-782c9d57-577a-4c4a-8fb7-eecc1ae29e1c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
63332025-06-04T15:50:52.501ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63342025-06-04T15:50:52.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63352025-06-04T15:50:52.503ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63362025-06-04T15:50:52.505ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
63372025-06-04T15:50:52.505ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63382025-06-04T15:50:52.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63392025-06-04T15:50:52.506ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
63402025-06-04T15:50:52.506ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 389072d3-5513-4141-a60f-4942292c83e8, kind: Service { id: 84104d89-910f-45b9-adb6-d23a6d4f41d6 }, name: Name("external-dns-84104d89-910f-45b9-adb6-d23a6d4f41d6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 172, 25])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fff3c2f8-b8b3-4438-8046-e8a2a3a5c986, kind: Service { id: 74458287-879a-4471-829f-da352f40aff2 }, name: Name("external-dns-74458287-879a-4471-829f-da352f40aff2"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 57])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 10b0c705-4d8e-4d51-bb19-677beab0068d, kind: Service { id: 543f2cf1-864a-4cc8-86a9-4279c52d053c }, name: Name("nexus-543f2cf1-864a-4cc8-86a9-4279c52d053c"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 189])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d8351219-a147-42d5-b119-bf9346e4a16f, kind: Service { id: 753f2fd8-42b8-4240-8646-4c4baf5591e2 }, name: Name("nexus-753f2fd8-42b8-4240-8646-4c4baf5591e2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e43cef14-db85-4ea2-b9ec-0b71960369e3, kind: Service { id: 782c9d57-577a-4c4a-8fb7-eecc1ae29e1c }, name: Name("nexus-782c9d57-577a-4c4a-8fb7-eecc1ae29e1c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 95])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
63412025-06-04T15:50:52.506ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
63422025-06-04T15:50:52.561ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: e751cd2d-7b1b-4ea0-8b5a-62525772a5f5, time_created: 2025-06-04T15:35:45.830825Z, time_modified: 2025-06-04T15:35:45.830825Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 2302d566-cff7-41c0-b6e9-4f6ac6057661, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(56094621696)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
63432025-06-04T15:50:52.561ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
63442025-06-04T15:50:52.592ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63452025-06-04T15:50:52.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63462025-06-04T15:50:52.594ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63472025-06-04T15:50:52.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63482025-06-04T15:50:52.596ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63492025-06-04T15:50:52.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: e751cd2d-7b1b-4ea0-8b5a-62525772a5f5, lookup_type: ById(e751cd2d-7b1b-4ea0-8b5a-62525772a5f5) } result = Ok(())
63502025-06-04T15:50:52.599ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
63512025-06-04T15:50:52.601ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9c367404-8bb9-4c0b-b26a-bbbb8e6966c7", "date": "Wed, 04 Jun 2025 15:50:52 GMT"} })
63522025-06-04T15:50:52.601ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 switch = Switch0
63532025-06-04T15:50:52.601ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
63542025-06-04T15:50:52.602ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 2302d566-cff7-41c0-b6e9-4f6ac6057661 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "104de8e3-5327-4ae4-8899-6207e434e3d4", "content-length": "682", "date": "Wed, 04 Jun 2025 15:50:51 GMT"} })
63552025-06-04T15:50:52.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63562025-06-04T15:50:52.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63572025-06-04T15:50:52.602ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = e751cd2d-7b1b-4ea0-8b5a-62525772a5f5 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "3d6fb4a7-fc3e-4647-a160-f5173251a881", "date": "Wed, 04 Jun 2025 15:50:51 GMT"} })
63582025-06-04T15:50:52.604ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:495
63592025-06-04T15:50:52.604ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 851.762473ms
63602025-06-04T15:50:52.605ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 851.771273ms iteration = 4 status = {}
63612025-06-04T15:50:52.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63622025-06-04T15:50:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63632025-06-04T15:50:52.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63642025-06-04T15:50:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63652025-06-04T15:50:52.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63662025-06-04T15:50:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63672025-06-04T15:50:52.618ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 866.453084ms iteration = 31 status = {}
63682025-06-04T15:50:52.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b861bc09-2cc8-45b2-914c-5bd4efbe0c35 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63692025-06-04T15:50:52.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b861bc09-2cc8-45b2-914c-5bd4efbe0c35 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63702025-06-04T15:50:52.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1761 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b861bc09-2cc8-45b2-914c-5bd4efbe0c35 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63712025-06-04T15:50:53.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 05f89720-9c41-40ce-b1b6-0456ab4ce6cf roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63722025-06-04T15:50:53.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 05f89720-9c41-40ce-b1b6-0456ab4ce6cf resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63732025-06-04T15:50:53.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2773 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 05f89720-9c41-40ce-b1b6-0456ab4ce6cf response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63742025-06-04T15:50:54.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8f77d625-66b9-4a22-bcd0-1728a3256d25 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63752025-06-04T15:50:54.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8f77d625-66b9-4a22-bcd0-1728a3256d25 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63762025-06-04T15:50:54.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 8f77d625-66b9-4a22-bcd0-1728a3256d25 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63772025-06-04T15:50:55.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 470beb4e-035d-489b-9d11-91ccd8b7cc7c roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63782025-06-04T15:50:55.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 470beb4e-035d-489b-9d11-91ccd8b7cc7c resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63792025-06-04T15:50:55.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2455 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 470beb4e-035d-489b-9d11-91ccd8b7cc7c response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63802025-06-04T15:50:56.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 660f72ed-1f0c-4d9f-b470-53bfb9bc0923 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63812025-06-04T15:50:56.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 660f72ed-1f0c-4d9f-b470-53bfb9bc0923 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63822025-06-04T15:50:56.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2818 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 660f72ed-1f0c-4d9f-b470-53bfb9bc0923 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63832025-06-04T15:50:57.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 024d6e70-7455-4615-a08d-14ea2ae8905e roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63842025-06-04T15:50:57.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 024d6e70-7455-4615-a08d-14ea2ae8905e resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63852025-06-04T15:50:57.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2630 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 024d6e70-7455-4615-a08d-14ea2ae8905e response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63862025-06-04T15:50:58.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 1caa307e-9aa3-4b36-a0f9-238c46fe424d roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63872025-06-04T15:50:58.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 1caa307e-9aa3-4b36-a0f9-238c46fe424d resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63882025-06-04T15:50:58.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 1caa307e-9aa3-4b36-a0f9-238c46fe424d response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63892025-06-04T15:50:59.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ddb7a4a9-f3e8-485f-9f9d-3aa5793c727e roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63902025-06-04T15:50:59.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ddb7a4a9-f3e8-485f-9f9d-3aa5793c727e resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63912025-06-04T15:50:59.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2478 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = ddb7a4a9-f3e8-485f-9f9d-3aa5793c727e response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63922025-06-04T15:50:59.954ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 538 local_addr = [fd00:1122:3344:101::c]:38490 method = GET remote_addr = [fd00:1122:3344:101::d]:33676 req_id = 629e23bb-7e7f-462a-b9b1-5ad458f6807b response_code = 200 uri = /782c9d57-577a-4c4a-8fb7-eecc1ae29e1c
63932025-06-04T15:51:00.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = c43d65c4-3300-476d-b012-d59a39b3ba00 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63942025-06-04T15:51:00.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = c43d65c4-3300-476d-b012-d59a39b3ba00 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63952025-06-04T15:51:00.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2478 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = c43d65c4-3300-476d-b012-d59a39b3ba00 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
63962025-06-04T15:51:01.753ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 92 reason = Timeout
63972025-06-04T15:51:01.753ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 92 reason = Timeout
63982025-06-04T15:51:01.753ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63992025-06-04T15:51:01.753ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64002025-06-04T15:51:01.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64012025-06-04T15:51:01.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64022025-06-04T15:51:01.755ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64032025-06-04T15:51:01.757ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64042025-06-04T15:51:01.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64052025-06-04T15:51:01.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64062025-06-04T15:51:01.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64072025-06-04T15:51:01.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64082025-06-04T15:51:01.761ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64092025-06-04T15:51:01.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: cbe54b72-1a80-4eb9-9342-f302b2908baf, lookup_type: ById(cbe54b72-1a80-4eb9-9342-f302b2908baf) } result = Ok(())
64102025-06-04T15:51:01.764ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64112025-06-04T15:51:01.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64122025-06-04T15:51:01.774ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf original_time_created = 2025-06-04 15:35:40.573919 UTC target_id = cbe54b72-1a80-4eb9-9342-f302b2908baf time_created = 2025-06-04 15:35:40.573919 UTC
64132025-06-04T15:51:01.774ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.559925ms iteration = 92 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"cbe54b72-1a80-4eb9-9342-f302b2908baf","time_created":"2025-06-04T15:35:40.573919Z"}
64142025-06-04T15:51:01.786ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64152025-06-04T15:51:01.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64162025-06-04T15:51:01.787ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.747867ms iteration = 92 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64172025-06-04T15:51:01.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6b2d95fa-a94b-4814-80e3-825e4443869e roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
64182025-06-04T15:51:01.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6b2d95fa-a94b-4814-80e3-825e4443869e resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
64192025-06-04T15:51:01.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1831 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 6b2d95fa-a94b-4814-80e3-825e4443869e response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
64202025-06-04T15:51:02.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b4567690-5d93-40cb-920c-ae46c4e6b211 roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
64212025-06-04T15:51:02.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b4567690-5d93-40cb-920c-ae46c4e6b211 resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
64222025-06-04T15:51:02.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b4567690-5d93-40cb-920c-ae46c4e6b211 response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
64232025-06-04T15:51:03.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b9b710a8-8798-4827-afa0-0f6065f0318c roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
64242025-06-04T15:51:03.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b9b710a8-8798-4827-afa0-0f6065f0318c resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
64252025-06-04T15:51:03.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = b9b710a8-8798-4827-afa0-0f6065f0318c response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
64262025-06-04T15:51:04.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 15337952-621d-4d21-8e41-96add2a7152e roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
64272025-06-04T15:51:04.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 15337952-621d-4d21-8e41-96add2a7152e resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
64282025-06-04T15:51:04.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1821 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = 15337952-621d-4d21-8e41-96add2a7152e response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
64292025-06-04T15:51:05.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a73bba3c-f858-4800-804b-5a3fab3102ea roles = RoleSet { roles: {} } uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
64302025-06-04T15:51:05.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a73bba3c-f858-4800-804b-5a3fab3102ea resource = Database result = Ok(()) uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5
64312025-06-04T15:51:05.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42354 req_id = a73bba3c-f858-4800-804b-5a3fab3102ea response_code = 200 uri = /probes/e751cd2d-7b1b-4ea0-8b5a-62525772a5f5