Max level shown:
12025-06-18T18:45:02.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cc755fd1-68dd-4ea2-a72f-64536b55e794 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22025-06-18T18:45:02.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cc755fd1-68dd-4ea2-a72f-64536b55e794 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
32025-06-18T18:45:02.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 7409 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cc755fd1-68dd-4ea2-a72f-64536b55e794 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
42025-06-18T18:45:03.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7ef2fea7-2982-4a62-a716-617e05696e36 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52025-06-18T18:45:03.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7ef2fea7-2982-4a62-a716-617e05696e36 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
62025-06-18T18:45:03.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2484 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7ef2fea7-2982-4a62-a716-617e05696e36 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
72025-06-18T18:45:04.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 77032fb3-30da-4d45-ae35-4fe957290ab7 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
82025-06-18T18:45:04.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 77032fb3-30da-4d45-ae35-4fe957290ab7 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
92025-06-18T18:45:04.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1983 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 77032fb3-30da-4d45-ae35-4fe957290ab7 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
102025-06-18T18:45:05.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 80927724-9ed2-41d1-b60a-044f002adcb8 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
112025-06-18T18:45:05.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 80927724-9ed2-41d1-b60a-044f002adcb8 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
122025-06-18T18:45:05.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2994 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 80927724-9ed2-41d1-b60a-044f002adcb8 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
132025-06-18T18:45:06.123ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:37917
142025-06-18T18:45:06.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = 14b4222d-1ef0-432d-8c08-11851c31b26a roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
152025-06-18T18:45:06.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = 14b4222d-1ef0-432d-8c08-11851c31b26a resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
162025-06-18T18:45:06.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2982 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = 14b4222d-1ef0-432d-8c08-11851c31b26a response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
172025-06-18T18:45:06.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = ada5939a-7eac-482a-9ec3-d6f8ca962505 roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
182025-06-18T18:45:06.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = ada5939a-7eac-482a-9ec3-d6f8ca962505 resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
192025-06-18T18:45:06.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2697 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = ada5939a-7eac-482a-9ec3-d6f8ca962505 response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
202025-06-18T18:45:06.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 80bf6491-8e79-42e7-b78a-634a96975ffa roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
212025-06-18T18:45:06.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 80bf6491-8e79-42e7-b78a-634a96975ffa resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
222025-06-18T18:45:06.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2618 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 80bf6491-8e79-42e7-b78a-634a96975ffa response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
232025-06-18T18:45:07.556ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
242025-06-18T18:45:07.556ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
252025-06-18T18:45:07.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
262025-06-18T18:45:07.556ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
272025-06-18T18:45:07.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
282025-06-18T18:45:07.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
292025-06-18T18:45:07.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
302025-06-18T18:45:07.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
312025-06-18T18:45:07.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
322025-06-18T18:45:07.561ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.02637ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
332025-06-18T18:45:07.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
342025-06-18T18:45:07.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
352025-06-18T18:45:07.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
362025-06-18T18:45:07.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
372025-06-18T18:45:07.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
382025-06-18T18:45:07.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
392025-06-18T18:45:07.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
402025-06-18T18:45:07.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
412025-06-18T18:45:07.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
422025-06-18T18:45:07.578ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
432025-06-18T18:45:07.578ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.152455ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
442025-06-18T18:45:07.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 39945275-6dc5-4cd6-9cd1-03a423cfb414 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
452025-06-18T18:45:07.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 39945275-6dc5-4cd6-9cd1-03a423cfb414 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
462025-06-18T18:45:07.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2064 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 39945275-6dc5-4cd6-9cd1-03a423cfb414 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
472025-06-18T18:45:08.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 69fc26f7-70bd-4951-b063-b19485eb6fe8 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
482025-06-18T18:45:08.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 69fc26f7-70bd-4951-b063-b19485eb6fe8 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
492025-06-18T18:45:08.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2146 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 69fc26f7-70bd-4951-b063-b19485eb6fe8 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
502025-06-18T18:45:09.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f324878f-d184-4e7d-85a4-60f52028bd0a roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
512025-06-18T18:45:09.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f324878f-d184-4e7d-85a4-60f52028bd0a resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
522025-06-18T18:45:09.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2382 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f324878f-d184-4e7d-85a4-60f52028bd0a response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
532025-06-18T18:45:10.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9c58965b-24f7-46e7-bf23-b157f24d5d3d roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
542025-06-18T18:45:10.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9c58965b-24f7-46e7-bf23-b157f24d5d3d resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
552025-06-18T18:45:10.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2493 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9c58965b-24f7-46e7-bf23-b157f24d5d3d response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
562025-06-18T18:45:11.132ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1060 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = b65e1fab-2c2d-43d9-bc97-64402a5abe86 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
572025-06-18T18:45:11.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 942b3963-b815-4fc7-bceb-861a899478ca roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
582025-06-18T18:45:11.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 942b3963-b815-4fc7-bceb-861a899478ca resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
592025-06-18T18:45:11.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1771 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 942b3963-b815-4fc7-bceb-861a899478ca response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
602025-06-18T18:45:12.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a0f527dd-4420-4167-957a-1b453dd9ae27 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
612025-06-18T18:45:12.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a0f527dd-4420-4167-957a-1b453dd9ae27 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
622025-06-18T18:45:12.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2289 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a0f527dd-4420-4167-957a-1b453dd9ae27 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
632025-06-18T18:45:13.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 17f292de-168d-4a0e-8afb-f49491cc6b10 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
642025-06-18T18:45:13.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 17f292de-168d-4a0e-8afb-f49491cc6b10 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
652025-06-18T18:45:13.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2200 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 17f292de-168d-4a0e-8afb-f49491cc6b10 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
662025-06-18T18:45:14.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 93407839-c22f-4d19-af83-ebd04dca92ca roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
672025-06-18T18:45:14.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 93407839-c22f-4d19-af83-ebd04dca92ca resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
682025-06-18T18:45:14.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2558 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 93407839-c22f-4d19-af83-ebd04dca92ca response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
692025-06-18T18:45:15.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ea1c3230-8efa-4149-b61f-7052bb3f03ad roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
702025-06-18T18:45:15.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ea1c3230-8efa-4149-b61f-7052bb3f03ad resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
712025-06-18T18:45:15.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2133 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ea1c3230-8efa-4149-b61f-7052bb3f03ad response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
722025-06-18T18:45:16.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b29f0e6a-6f56-44dd-8857-e2bf014dc5e7 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
732025-06-18T18:45:16.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b29f0e6a-6f56-44dd-8857-e2bf014dc5e7 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
742025-06-18T18:45:16.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1735 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b29f0e6a-6f56-44dd-8857-e2bf014dc5e7 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
752025-06-18T18:45:17.556ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
762025-06-18T18:45:17.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
772025-06-18T18:45:17.556ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
782025-06-18T18:45:17.556ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
792025-06-18T18:45:17.556ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
802025-06-18T18:45:17.556ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
812025-06-18T18:45:17.556ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
822025-06-18T18:45:17.556ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
832025-06-18T18:45:17.556ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
842025-06-18T18:45:17.556ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
852025-06-18T18:45:17.556ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
862025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 20 reason = Timeout
872025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
882025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
892025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
902025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
912025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 20 reason = Timeout
922025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
932025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
942025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
952025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
962025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
972025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
982025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
992025-06-18T18:45:17.557ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1002025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1012025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
1022025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1032025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
1042025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1052025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1062025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
1072025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1082025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
1092025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1102025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
1112025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1122025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
1132025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1142025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1152025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1162025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1172025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1182025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1192025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1202025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1212025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1222025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1232025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1242025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1252025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1262025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1272025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1282025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1292025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1302025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
1312025-06-18T18:45:17.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1322025-06-18T18:45:17.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1332025-06-18T18:45:17.559ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1342025-06-18T18:45:17.560ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.469708ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
1352025-06-18T18:45:17.560ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1362025-06-18T18:45:17.561ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.986945ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1372025-06-18T18:45:17.561ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1507, tv_nsec: 144241258 } })
1382025-06-18T18:45:17.562ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
1392025-06-18T18:45:17.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
1402025-06-18T18:45:17.563ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1412025-06-18T18:45:17.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1422025-06-18T18:45:17.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1432025-06-18T18:45:17.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1442025-06-18T18:45:17.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1452025-06-18T18:45:17.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1462025-06-18T18:45:17.563ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1472025-06-18T18:45:17.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1482025-06-18T18:45:17.565ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1492025-06-18T18:45:17.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1502025-06-18T18:45:17.566ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1512025-06-18T18:45:17.566ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1522025-06-18T18:45:17.567ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1532025-06-18T18:45:17.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1542025-06-18T18:45:17.569ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1552025-06-18T18:45:17.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1562025-06-18T18:45:17.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1572025-06-18T18:45:17.570ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1582025-06-18T18:45:17.570ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1592025-06-18T18:45:17.570ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1602025-06-18T18:45:17.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1612025-06-18T18:45:17.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1622025-06-18T18:45:17.571ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1632025-06-18T18:45:17.572ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1642025-06-18T18:45:17.572ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1652025-06-18T18:45:17.572ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1662025-06-18T18:45:17.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1672025-06-18T18:45:17.573ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1507, tv_nsec: 156348755 } })
1682025-06-18T18:45:17.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1692025-06-18T18:45:17.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1702025-06-18T18:45:17.574ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1712025-06-18T18:45:17.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1722025-06-18T18:45:17.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1732025-06-18T18:45:17.574ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
1742025-06-18T18:45:17.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1752025-06-18T18:45:17.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1762025-06-18T18:45:17.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1772025-06-18T18:45:17.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1782025-06-18T18:45:17.576ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1792025-06-18T18:45:17.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1802025-06-18T18:45:17.577ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1812025-06-18T18:45:17.577ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1507, tv_nsec: 159889794 } })
1822025-06-18T18:45:17.577ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1832025-06-18T18:45:17.577ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
1842025-06-18T18:45:17.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1852025-06-18T18:45:17.578ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1862025-06-18T18:45:17.580ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1872025-06-18T18:45:17.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1882025-06-18T18:45:17.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1892025-06-18T18:45:17.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
1902025-06-18T18:45:17.580ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1912025-06-18T18:45:17.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1922025-06-18T18:45:17.582ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1932025-06-18T18:45:17.583ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1942025-06-18T18:45:17.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
1952025-06-18T18:45:17.589ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1962025-06-18T18:45:17.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1972025-06-18T18:45:17.589ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1982025-06-18T18:45:17.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1992025-06-18T18:45:17.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2002025-06-18T18:45:17.605ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
2012025-06-18T18:45:17.605ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.115548ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
2022025-06-18T18:45:17.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 56.010412ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
2032025-06-18T18:45:17.616ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2042025-06-18T18:45:17.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2052025-06-18T18:45:17.619ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2062025-06-18T18:45:17.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2072025-06-18T18:45:17.620ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 63.708479ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2082025-06-18T18:45:17.621ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2092025-06-18T18:45:17.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2102025-06-18T18:45:17.621ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2112025-06-18T18:45:17.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2122025-06-18T18:45:17.622ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 65.506734ms iteration = 20 status = {"errors":[],"requests_created_ok":[]}
2132025-06-18T18:45:17.626ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2142025-06-18T18:45:17.626ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 69.672551ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2152025-06-18T18:45:17.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.552493ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2162025-06-18T18:45:17.628ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
2172025-06-18T18:45:17.628ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 71.884222ms iteration = 20 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
2182025-06-18T18:45:17.629ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2192025-06-18T18:45:17.629ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2202025-06-18T18:45:17.629ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2212025-06-18T18:45:17.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2222025-06-18T18:45:17.641ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
2232025-06-18T18:45:17.641ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2242025-06-18T18:45:17.642ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d5beee8-0164-482d-82c6-0d078744a1f6", "content-length": "26", "date": "Wed, 18 Jun 2025 18:45:17 GMT"} })
2252025-06-18T18:45:17.642ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2262025-06-18T18:45:17.643ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2272025-06-18T18:45:17.695ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f zone_address = fd00:1122:3344:101::2
2282025-06-18T18:45:17.695ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2292025-06-18T18:45:17.695ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "41355745-1e7c-4527-b89e-df3750c88b49", "content-length": "26", "date": "Wed, 18 Jun 2025 18:45:17 GMT"} })
2302025-06-18T18:45:17.695ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2312025-06-18T18:45:17.696ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
2322025-06-18T18:45:17.704ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 147.607547ms iteration = 22 status = {"physical_disks_added":0}
2332025-06-18T18:45:17.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b4c43c46-d815-4b9c-be0d-58701789f9a4 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
2342025-06-18T18:45:17.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b4c43c46-d815-4b9c-be0d-58701789f9a4 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
2352025-06-18T18:45:17.762ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2362025-06-18T18:45:17.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2372025-06-18T18:45:17.795ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
2382025-06-18T18:45:17.795ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2392025-06-18T18:45:17.795ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c21f596-7d1e-4b97-a6fc-d21cfe0fd293", "content-length": "26", "date": "Wed, 18 Jun 2025 18:45:17 GMT"} })
2402025-06-18T18:45:17.795ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2412025-06-18T18:45:17.798ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2422025-06-18T18:45:17.811ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
2432025-06-18T18:45:17.811ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2442025-06-18T18:45:17.812ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c901e077-46ed-4f88-82a9-b476e2007945", "content-length": "372", "date": "Wed, 18 Jun 2025 18:45:17 GMT"} })
2452025-06-18T18:45:17.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2462025-06-18T18:45:17.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2472025-06-18T18:45:17.814ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2482025-06-18T18:45:17.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2492025-06-18T18:45:17.816ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2502025-06-18T18:45:17.816ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2512025-06-18T18:45:17.816ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 259.138285ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2522025-06-18T18:45:17.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 59203 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b4c43c46-d815-4b9c-be0d-58701789f9a4 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
2532025-06-18T18:45:17.817ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 260.429943ms iteration = 20 status = null
2542025-06-18T18:45:17.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2552025-06-18T18:45:17.851ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 294.676216ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2562025-06-18T18:45:17.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2572025-06-18T18:45:17.856ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2582025-06-18T18:45:17.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9fbbc826-5b83-4b80-8172-66302c618aae, lookup_type: ById(9fbbc826-5b83-4b80-8172-66302c618aae) } result = Ok(())
2592025-06-18T18:45:17.859ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2602025-06-18T18:45:17.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2612025-06-18T18:45:17.861ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 304.405279ms iteration = 20 status = 0
2622025-06-18T18:45:17.865ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 307.877398ms iteration = 20 status = {}
2632025-06-18T18:45:17.866ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
2642025-06-18T18:45:17.866ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
2652025-06-18T18:45:17.867ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4e4d80d5-03a5-4a0b-a83d-d8e1f2e66556", "date": "Wed, 18 Jun 2025 18:45:17 GMT"} })
2662025-06-18T18:45:17.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2672025-06-18T18:45:17.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2682025-06-18T18:45:17.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2692025-06-18T18:45:17.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2702025-06-18T18:45:17.872ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2712025-06-18T18:45:17.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2722025-06-18T18:45:17.876ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
2732025-06-18T18:45:17.876ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2742025-06-18T18:45:17.876ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "679c7b25-c2ba-476a-a75b-371a385c6d1a", "date": "Wed, 18 Jun 2025 18:45:17 GMT"} })
2752025-06-18T18:45:17.877ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 320.769376ms iteration = 20 status = {}
2762025-06-18T18:45:17.886ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 329.207122ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
2772025-06-18T18:45:17.894ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2782025-06-18T18:45:17.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2792025-06-18T18:45:17.897ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 7e1ff921-047f-464e-8081-f8132af716ac, rack_id: 3a330d2e-6212-46a4-9781-374fdb3dc92f, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(6c07c314-d66b-4041-9040-d774200d26a9) } rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
2802025-06-18T18:45:17.897ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2812025-06-18T18:45:17.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2822025-06-18T18:45:17.908ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
2832025-06-18T18:45:17.908ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 6c07c314-d66b-4041-9040-d774200d26a9
2842025-06-18T18:45:17.909ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
2852025-06-18T18:45:17.909ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
2862025-06-18T18:45:17.909ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2872025-06-18T18:45:17.909ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2882025-06-18T18:45:17.909ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2892025-06-18T18:45:17.909ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2902025-06-18T18:45:17.909ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
2912025-06-18T18:45:17.909ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
2922025-06-18T18:45:17.909ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
2932025-06-18T18:45:17.909ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2942025-06-18T18:45:17.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2952025-06-18T18:45:17.911ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
2962025-06-18T18:45:17.911ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
2972025-06-18T18:45:17.913ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2982025-06-18T18:45:17.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2992025-06-18T18:45:17.915ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3002025-06-18T18:45:17.917ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3012025-06-18T18:45:17.917ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3022025-06-18T18:45:17.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3032025-06-18T18:45:17.955ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3042025-06-18T18:45:17.957ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3052025-06-18T18:45:17.957ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3062025-06-18T18:45:17.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3072025-06-18T18:45:18.014ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6da410c9-4a04-4c74-945a-9ebb0e2c32ce", "date": "Wed, 18 Jun 2025 18:45:17 GMT"} })
3082025-06-18T18:45:18.015ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch = Switch0
3092025-06-18T18:45:18.015ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
3102025-06-18T18:45:18.015ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "918208c1-6c0a-41e6-ae65-e59b9a943f77", "content-length": "682", "date": "Wed, 18 Jun 2025 18:45:17 GMT"} })
3112025-06-18T18:45:18.015ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3122025-06-18T18:45:18.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3132025-06-18T18:45:18.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3142025-06-18T18:45:18.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3152025-06-18T18:45:18.023ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3162025-06-18T18:45:18.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3172025-06-18T18:45:18.025ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3182025-06-18T18:45:18.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3192025-06-18T18:45:18.033ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 476.331992ms iteration = 20 status = {}
3202025-06-18T18:45:18.052ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
3212025-06-18T18:45:18.052ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c7ccadf-e261-4ae9-be9c-9e11a32cb5ef", "content-length": "691", "date": "Wed, 18 Jun 2025 18:45:18 GMT"} })
3222025-06-18T18:45:18.052ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
3232025-06-18T18:45:18.052ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
3242025-06-18T18:45:18.052ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
3252025-06-18T18:45:18.053ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 496.556901ms iteration = 20 status = {}
3262025-06-18T18:45:18.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 616e3dff-f290-48a2-8178-ab275d61759a roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3272025-06-18T18:45:18.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 616e3dff-f290-48a2-8178-ab275d61759a resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3282025-06-18T18:45:18.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1879 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 616e3dff-f290-48a2-8178-ab275d61759a response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3292025-06-18T18:45:19.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7928650c-41d2-413e-9826-c23ed61eee17 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3302025-06-18T18:45:19.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7928650c-41d2-413e-9826-c23ed61eee17 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3312025-06-18T18:45:19.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2503 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7928650c-41d2-413e-9826-c23ed61eee17 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3322025-06-18T18:45:20.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cf3a45f7-1fc6-4a47-89d4-e30cdca1f5b7 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3332025-06-18T18:45:20.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cf3a45f7-1fc6-4a47-89d4-e30cdca1f5b7 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3342025-06-18T18:45:20.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2131 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cf3a45f7-1fc6-4a47-89d4-e30cdca1f5b7 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3352025-06-18T18:45:21.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = f7995c78-4742-45c8-91fb-de5bdb808dce roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
3362025-06-18T18:45:21.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = f7995c78-4742-45c8-91fb-de5bdb808dce resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
3372025-06-18T18:45:21.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2776 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = f7995c78-4742-45c8-91fb-de5bdb808dce response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
3382025-06-18T18:45:21.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = d193473b-885d-4fc1-9a1a-f45c75ccfa6f roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
3392025-06-18T18:45:21.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = d193473b-885d-4fc1-9a1a-f45c75ccfa6f resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
3402025-06-18T18:45:21.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2397 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = d193473b-885d-4fc1-9a1a-f45c75ccfa6f response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
3412025-06-18T18:45:21.131ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 564 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 8773e442-97f8-4616-b3b1-196dae8b18d8 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
3422025-06-18T18:45:21.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5b53d983-f724-4b69-9949-0b0d6569b5d3 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3432025-06-18T18:45:21.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5b53d983-f724-4b69-9949-0b0d6569b5d3 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3442025-06-18T18:45:21.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2399 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5b53d983-f724-4b69-9949-0b0d6569b5d3 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3452025-06-18T18:45:22.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f48a0ad8-e100-4fd4-9139-e44f9720543c roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3462025-06-18T18:45:22.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f48a0ad8-e100-4fd4-9139-e44f9720543c resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3472025-06-18T18:45:22.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f48a0ad8-e100-4fd4-9139-e44f9720543c response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3482025-06-18T18:45:23.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 84c9520e-a6c6-4af0-90cd-eab559ee0799 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3492025-06-18T18:45:23.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 84c9520e-a6c6-4af0-90cd-eab559ee0799 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3502025-06-18T18:45:23.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2355 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 84c9520e-a6c6-4af0-90cd-eab559ee0799 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3512025-06-18T18:45:24.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = afe721bb-07f6-4dec-80bd-df8b7bf502b5 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3522025-06-18T18:45:24.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = afe721bb-07f6-4dec-80bd-df8b7bf502b5 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3532025-06-18T18:45:24.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2554 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = afe721bb-07f6-4dec-80bd-df8b7bf502b5 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3542025-06-18T18:45:25.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5cafc614-4b6b-4957-8551-f9134ef37cfd roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3552025-06-18T18:45:25.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5cafc614-4b6b-4957-8551-f9134ef37cfd resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3562025-06-18T18:45:25.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2448 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5cafc614-4b6b-4957-8551-f9134ef37cfd response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3572025-06-18T18:45:26.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6e9e1640-8747-4930-9625-9e5ca3971b83 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3582025-06-18T18:45:26.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6e9e1640-8747-4930-9625-9e5ca3971b83 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3592025-06-18T18:45:26.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2043 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6e9e1640-8747-4930-9625-9e5ca3971b83 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3602025-06-18T18:45:27.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
3612025-06-18T18:45:27.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
3622025-06-18T18:45:27.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3632025-06-18T18:45:27.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3642025-06-18T18:45:27.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3652025-06-18T18:45:27.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3662025-06-18T18:45:27.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3672025-06-18T18:45:27.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3682025-06-18T18:45:27.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3692025-06-18T18:45:27.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3702025-06-18T18:45:27.595ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3712025-06-18T18:45:27.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3722025-06-18T18:45:27.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3732025-06-18T18:45:27.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3742025-06-18T18:45:27.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3752025-06-18T18:45:27.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
3762025-06-18T18:45:27.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3772025-06-18T18:45:27.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3782025-06-18T18:45:27.611ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
3792025-06-18T18:45:27.611ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.135557ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
3802025-06-18T18:45:27.629ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.022314ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3812025-06-18T18:45:27.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 67b8bb35-4d94-4e9b-b95d-75c02e95390f roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3822025-06-18T18:45:27.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 67b8bb35-4d94-4e9b-b95d-75c02e95390f resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3832025-06-18T18:45:27.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2021 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 67b8bb35-4d94-4e9b-b95d-75c02e95390f response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3842025-06-18T18:45:28.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3e429f86-1809-48c8-9580-2d39d72038b3 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3852025-06-18T18:45:28.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3e429f86-1809-48c8-9580-2d39d72038b3 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3862025-06-18T18:45:28.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1885 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3e429f86-1809-48c8-9580-2d39d72038b3 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3872025-06-18T18:45:30.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 823985f4-e92f-49ae-8c84-29d944389a0a roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3882025-06-18T18:45:30.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 823985f4-e92f-49ae-8c84-29d944389a0a resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3892025-06-18T18:45:30.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1842 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 823985f4-e92f-49ae-8c84-29d944389a0a response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3902025-06-18T18:45:31.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1a6b2977-76c6-4a7a-8ce1-3ad47a520aa0 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3912025-06-18T18:45:31.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1a6b2977-76c6-4a7a-8ce1-3ad47a520aa0 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3922025-06-18T18:45:31.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2480 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1a6b2977-76c6-4a7a-8ce1-3ad47a520aa0 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3932025-06-18T18:45:31.131ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 595 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 7c6b7d93-f0cc-4fd1-810d-e59345c891b4 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
3942025-06-18T18:45:32.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bdd5297c-257a-4fee-afc8-ecb8dd20a2df roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3952025-06-18T18:45:32.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bdd5297c-257a-4fee-afc8-ecb8dd20a2df resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3962025-06-18T18:45:32.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2259 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bdd5297c-257a-4fee-afc8-ecb8dd20a2df response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3972025-06-18T18:45:33.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 45f2c803-99a7-4902-961d-bb5c373a87e1 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3982025-06-18T18:45:33.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 45f2c803-99a7-4902-961d-bb5c373a87e1 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
3992025-06-18T18:45:33.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1653 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 45f2c803-99a7-4902-961d-bb5c373a87e1 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4002025-06-18T18:45:34.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 97f1c668-b999-40e7-9954-3523658bc908 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4012025-06-18T18:45:34.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 97f1c668-b999-40e7-9954-3523658bc908 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4022025-06-18T18:45:34.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2077 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 97f1c668-b999-40e7-9954-3523658bc908 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4032025-06-18T18:45:35.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c8755a8a-f054-4277-9c36-16e1f6d88368 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4042025-06-18T18:45:35.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c8755a8a-f054-4277-9c36-16e1f6d88368 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4052025-06-18T18:45:35.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2081 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c8755a8a-f054-4277-9c36-16e1f6d88368 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4062025-06-18T18:45:36.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8ea33a42-1459-473a-89ab-90714983f902 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4072025-06-18T18:45:36.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8ea33a42-1459-473a-89ab-90714983f902 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4082025-06-18T18:45:36.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2428 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8ea33a42-1459-473a-89ab-90714983f902 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4092025-06-18T18:45:37.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d52d24ae-905b-48bb-9b24-2122afca1308 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4102025-06-18T18:45:37.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d52d24ae-905b-48bb-9b24-2122afca1308 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4112025-06-18T18:45:37.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1701 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d52d24ae-905b-48bb-9b24-2122afca1308 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4122025-06-18T18:45:37.556ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
4132025-06-18T18:45:37.556ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4142025-06-18T18:45:37.556ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
4152025-06-18T18:45:37.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4162025-06-18T18:45:37.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4172025-06-18T18:45:37.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4182025-06-18T18:45:37.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4192025-06-18T18:45:37.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4202025-06-18T18:45:37.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4212025-06-18T18:45:37.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4222025-06-18T18:45:37.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4232025-06-18T18:45:37.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4242025-06-18T18:45:37.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4252025-06-18T18:45:37.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
4262025-06-18T18:45:37.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4272025-06-18T18:45:37.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4282025-06-18T18:45:37.576ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
4292025-06-18T18:45:37.576ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.805724ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
4302025-06-18T18:45:37.589ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4312025-06-18T18:45:37.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4322025-06-18T18:45:37.628ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.419155ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4332025-06-18T18:45:38.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 2af68ac0-b310-4d93-99f9-5f711caed1d1 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4342025-06-18T18:45:38.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 2af68ac0-b310-4d93-99f9-5f711caed1d1 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4352025-06-18T18:45:38.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2140 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 2af68ac0-b310-4d93-99f9-5f711caed1d1 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4362025-06-18T18:45:39.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 640203ed-e3a1-469c-a8ec-f3d30b530d6a roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4372025-06-18T18:45:39.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 640203ed-e3a1-469c-a8ec-f3d30b530d6a resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4382025-06-18T18:45:39.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2309 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 640203ed-e3a1-469c-a8ec-f3d30b530d6a response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4392025-06-18T18:45:40.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4375bbe0-e060-493b-b6c1-3f185eddb41a roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4402025-06-18T18:45:40.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4375bbe0-e060-493b-b6c1-3f185eddb41a resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4412025-06-18T18:45:40.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2381 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4375bbe0-e060-493b-b6c1-3f185eddb41a response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4422025-06-18T18:45:41.131ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 527 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 9470d5dc-b970-4421-b36d-58457f7d5e59 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
4432025-06-18T18:45:41.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c30eadfa-78d0-4d6e-8be6-a694a4e5c4c0 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4442025-06-18T18:45:41.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c30eadfa-78d0-4d6e-8be6-a694a4e5c4c0 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4452025-06-18T18:45:41.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2086 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c30eadfa-78d0-4d6e-8be6-a694a4e5c4c0 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4462025-06-18T18:45:42.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ad578bbb-ddca-40ec-a9b1-4ae6660cc8ae roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4472025-06-18T18:45:42.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ad578bbb-ddca-40ec-a9b1-4ae6660cc8ae resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4482025-06-18T18:45:42.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2252 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ad578bbb-ddca-40ec-a9b1-4ae6660cc8ae response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4492025-06-18T18:45:43.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3e3c1717-5208-4fb1-8511-722126ea2c72 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4502025-06-18T18:45:43.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3e3c1717-5208-4fb1-8511-722126ea2c72 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4512025-06-18T18:45:43.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2889 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3e3c1717-5208-4fb1-8511-722126ea2c72 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4522025-06-18T18:45:44.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 795c9f6a-1904-4103-8ca5-df7ffcea1b8c roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4532025-06-18T18:45:44.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 795c9f6a-1904-4103-8ca5-df7ffcea1b8c resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4542025-06-18T18:45:44.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2375 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 795c9f6a-1904-4103-8ca5-df7ffcea1b8c response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4552025-06-18T18:45:45.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4793f81a-9734-4f6e-97e9-08a41d7f32cd roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4562025-06-18T18:45:45.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4793f81a-9734-4f6e-97e9-08a41d7f32cd resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4572025-06-18T18:45:45.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1968 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4793f81a-9734-4f6e-97e9-08a41d7f32cd response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4582025-06-18T18:45:46.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 73f66c07-f445-460f-94be-c39b85b0e52a roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4592025-06-18T18:45:46.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 73f66c07-f445-460f-94be-c39b85b0e52a resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4602025-06-18T18:45:46.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2289 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 73f66c07-f445-460f-94be-c39b85b0e52a response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4612025-06-18T18:45:47.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 62439636-ef38-4409-9eb3-e9bb489c88bb roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4622025-06-18T18:45:47.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 62439636-ef38-4409-9eb3-e9bb489c88bb resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4632025-06-18T18:45:47.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1873 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 62439636-ef38-4409-9eb3-e9bb489c88bb response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
4642025-06-18T18:45:47.556ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
4652025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
4662025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4672025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4682025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4692025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
4702025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4712025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
4722025-06-18T18:45:47.557ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4732025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4742025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4752025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
4762025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4772025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
4782025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
4792025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4802025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
4812025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4822025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
4832025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4842025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4852025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
4862025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4872025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
4882025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4892025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
4902025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4912025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
4922025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4932025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 21 reason = Timeout
4942025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
4952025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
4962025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
4972025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 21 reason = Timeout
4982025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4992025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
5002025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
5012025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
5022025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
5032025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 11 reason = Timeout
5042025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
5052025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
5062025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
5072025-06-18T18:45:47.557ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
5082025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5092025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 5 reason = Timeout
5102025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5112025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
5122025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
5132025-06-18T18:45:47.557ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe
5142025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.891\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe"}
5152025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
5162025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
5172025-06-18T18:45:47.557ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
5182025-06-18T18:45:47.557ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-18 18:35:47.557453532 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
5192025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5202025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
5212025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
5222025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5232025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
5242025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
5252025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
5262025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5272025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
5282025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
5292025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
5302025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
5312025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5322025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5332025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5342025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
5352025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 3 reason = Timeout
5362025-06-18T18:45:47.557ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
5372025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
5382025-06-18T18:45:47.557ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
5392025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
5402025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
5412025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
5422025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
5432025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
5442025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
5452025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5462025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
5472025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 11 reason = Timeout
5482025-06-18T18:45:47.557ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
5492025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5502025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5512025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5522025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5532025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5542025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5552025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5562025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5572025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5582025-06-18T18:45:47.558ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("03fce462-e4e1-4a86-890b-8a2ae9e17168.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("800703b5-0601-4ce2-acc3-d5b9ca473160.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("800703b5-0601-4ce2-acc3-d5b9ca473160.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1537, tv_nsec: 140143623 } })
5592025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5602025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
5612025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
5622025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
5632025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
5642025-06-18T18:45:47.558ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("51411444-5ad0-46e8-b345-7ee26fb32a60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("adea75c9-2ff2-4f9f-bfac-48c7702333e0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea7c6eed-68db-4cd0-929a-17b08777d263.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea7c6eed-68db-4cd0-929a-17b08777d263.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1537, tv_nsec: 140195013 } })
5652025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5662025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5672025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5682025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5692025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5702025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
5712025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5722025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5732025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5742025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5752025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5762025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5772025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5782025-06-18T18:45:47.558ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
5792025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
5802025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5812025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
5822025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.185806ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
5832025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
5842025-06-18T18:45:47.558ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.209987ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
5852025-06-18T18:45:47.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5862025-06-18T18:45:47.560ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5872025-06-18T18:45:47.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5882025-06-18T18:45:47.560ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5892025-06-18T18:45:47.560ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5902025-06-18T18:45:47.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5912025-06-18T18:45:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5922025-06-18T18:45:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5932025-06-18T18:45:47.560ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5942025-06-18T18:45:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5952025-06-18T18:45:47.561ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.089686ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5962025-06-18T18:45:47.561ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5972025-06-18T18:45:47.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5982025-06-18T18:45:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5992025-06-18T18:45:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
6002025-06-18T18:45:47.563ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6012025-06-18T18:45:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6022025-06-18T18:45:47.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6032025-06-18T18:45:47.564ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.921246ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
6042025-06-18T18:45:47.565ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.96289ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
6052025-06-18T18:45:47.565ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6062025-06-18T18:45:47.566ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6072025-06-18T18:45:47.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6082025-06-18T18:45:47.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6092025-06-18T18:45:47.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6102025-06-18T18:45:47.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6112025-06-18T18:45:47.568ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6122025-06-18T18:45:47.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6132025-06-18T18:45:47.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
6142025-06-18T18:45:47.568ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
6152025-06-18T18:45:47.568ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6162025-06-18T18:45:47.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
6172025-06-18T18:45:47.568ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6182025-06-18T18:45:47.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6192025-06-18T18:45:47.570ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
6202025-06-18T18:45:47.570ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 13.373025ms iteration = 11 status = {"by_rx":{},"error":null}
6212025-06-18T18:45:47.570ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6222025-06-18T18:45:47.570ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6232025-06-18T18:45:47.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6242025-06-18T18:45:47.573ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.693587ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
6252025-06-18T18:45:47.573ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-18 18:35:47.557453532 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
6262025-06-18T18:45:47.573ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.96477ms iteration = 11 status = {"expiration":"2025-06-18T18:35:47.557453532Z","pruned":[]}
6272025-06-18T18:45:47.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6282025-06-18T18:45:47.574ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6292025-06-18T18:45:47.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
6302025-06-18T18:45:47.576ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6312025-06-18T18:45:47.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6322025-06-18T18:45:47.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
6332025-06-18T18:45:47.577ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6342025-06-18T18:45:47.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
6352025-06-18T18:45:47.578ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6362025-06-18T18:45:47.578ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1537, tv_nsec: 160532524 } })
6372025-06-18T18:45:47.578ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
6382025-06-18T18:45:47.579ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1537, tv_nsec: 161627109 } })
6392025-06-18T18:45:47.579ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
6402025-06-18T18:45:47.580ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
6412025-06-18T18:45:47.580ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6422025-06-18T18:45:47.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
6432025-06-18T18:45:47.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6442025-06-18T18:45:47.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6452025-06-18T18:45:47.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6462025-06-18T18:45:47.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6472025-06-18T18:45:47.594ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6482025-06-18T18:45:47.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6492025-06-18T18:45:47.619ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6502025-06-18T18:45:47.620ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6512025-06-18T18:45:47.620ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6522025-06-18T18:45:47.620ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 62.698385ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6532025-06-18T18:45:47.622ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6542025-06-18T18:45:47.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6552025-06-18T18:45:47.622ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6562025-06-18T18:45:47.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6572025-06-18T18:45:47.623ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
6582025-06-18T18:45:47.623ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
6592025-06-18T18:45:47.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
6602025-06-18T18:45:47.624ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
6612025-06-18T18:45:47.625ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6622025-06-18T18:45:47.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6632025-06-18T18:45:47.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
6642025-06-18T18:45:47.626ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6652025-06-18T18:45:47.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6662025-06-18T18:45:47.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
6672025-06-18T18:45:47.627ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
6682025-06-18T18:45:47.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
6692025-06-18T18:45:47.628ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
6702025-06-18T18:45:47.628ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6712025-06-18T18:45:47.629ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 71.73111ms iteration = 21 status = {"errors":[],"requests_created_ok":[]}
6722025-06-18T18:45:47.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6732025-06-18T18:45:47.630ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6742025-06-18T18:45:47.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6752025-06-18T18:45:47.633ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6762025-06-18T18:45:47.634ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6772025-06-18T18:45:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6782025-06-18T18:45:47.635ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
6792025-06-18T18:45:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
6802025-06-18T18:45:47.637ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(c6a8e7bb-2ea0-4d1b-beae-53d9b06fc3b1, 0), (812e1124-e017-4b14-8482-7fcb648056b2, 0), (317e8971-fb2e-498c-a913-cadefa993520, 0), (b362ccd3-b8a9-4eac-bf74-70f09bcb7bad, 0)] collection_id = c6a8e7bb-2ea0-4d1b-beae-53d9b06fc3b1
6812025-06-18T18:45:47.637ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6822025-06-18T18:45:47.637ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6832025-06-18T18:45:47.637ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6842025-06-18T18:45:47.637ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6852025-06-18T18:45:47.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
6862025-06-18T18:45:47.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6872025-06-18T18:45:47.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6882025-06-18T18:45:47.639ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6892025-06-18T18:45:47.639ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6902025-06-18T18:45:47.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6912025-06-18T18:45:47.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6922025-06-18T18:45:47.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6932025-06-18T18:45:47.640ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 83.491592ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6942025-06-18T18:45:47.641ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6952025-06-18T18:45:47.641ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 83.922137ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6962025-06-18T18:45:47.641ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6972025-06-18T18:45:47.641ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6982025-06-18T18:45:47.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
6992025-06-18T18:45:47.643ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7002025-06-18T18:45:47.643ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7012025-06-18T18:45:47.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
7022025-06-18T18:45:47.643ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1537, tv_nsec: 225398249 } })
7032025-06-18T18:45:47.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7042025-06-18T18:45:47.643ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
7052025-06-18T18:45:47.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
7062025-06-18T18:45:47.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7072025-06-18T18:45:47.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7082025-06-18T18:45:47.644ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
7092025-06-18T18:45:47.644ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
7102025-06-18T18:45:47.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
7112025-06-18T18:45:47.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7122025-06-18T18:45:47.645ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7132025-06-18T18:45:47.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7142025-06-18T18:45:47.646ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7152025-06-18T18:45:47.646ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7162025-06-18T18:45:47.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7172025-06-18T18:45:47.647ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7182025-06-18T18:45:47.647ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 90.299846ms iteration = 11 status = {"dispatched":[],"errors":[],"glob_version":"150.0.0","globs_reprocessed":{},"no_receivers":[]}
7192025-06-18T18:45:47.648ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7202025-06-18T18:45:47.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7212025-06-18T18:45:47.649ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
7222025-06-18T18:45:47.649ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 91.517853ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
7232025-06-18T18:45:47.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
7242025-06-18T18:45:47.650ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7252025-06-18T18:45:47.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7262025-06-18T18:45:47.650ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 94.037707ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7272025-06-18T18:45:47.668ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
7282025-06-18T18:45:47.668ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 111.284286ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
7292025-06-18T18:45:47.670ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7302025-06-18T18:45:47.670ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7312025-06-18T18:45:47.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7322025-06-18T18:45:47.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7332025-06-18T18:45:47.674ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7342025-06-18T18:45:47.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7352025-06-18T18:45:47.676ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
7362025-06-18T18:45:47.676ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
7372025-06-18T18:45:47.676ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 119.572199ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
7382025-06-18T18:45:47.680ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7392025-06-18T18:45:47.682ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
7402025-06-18T18:45:47.682ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
7412025-06-18T18:45:47.682ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
7422025-06-18T18:45:47.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7432025-06-18T18:45:47.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7442025-06-18T18:45:47.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7452025-06-18T18:45:47.687ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
7462025-06-18T18:45:47.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
7472025-06-18T18:45:47.698ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7482025-06-18T18:45:47.698ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7492025-06-18T18:45:47.698ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 141.246289ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7502025-06-18T18:45:47.704ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 146.898696ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7512025-06-18T18:45:47.705ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 148.286685ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
7522025-06-18T18:45:47.706ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
7532025-06-18T18:45:47.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
7542025-06-18T18:45:47.720ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
7552025-06-18T18:45:47.720ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
7562025-06-18T18:45:47.720ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
7572025-06-18T18:45:47.720ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7582025-06-18T18:45:47.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7592025-06-18T18:45:47.728ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
7602025-06-18T18:45:47.728ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7612025-06-18T18:45:47.729ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8058bf9d-bdd4-4e94-a3e5-9ee3c94467f0", "content-length": "26", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
7622025-06-18T18:45:47.729ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7632025-06-18T18:45:47.731ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7642025-06-18T18:45:47.733ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
7652025-06-18T18:45:47.733ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7662025-06-18T18:45:47.733ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "da7be5e7-f724-4cfb-9373-5e7da868e9e8", "content-length": "26", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
7672025-06-18T18:45:47.733ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7682025-06-18T18:45:47.734ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = c6a8e7bb-2ea0-4d1b-beae-53d9b06fc3b1 file = nexus/db-queries/src/db/datastore/inventory.rs:1740 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nlast_reconciliation_dataset_results = 0 nlast_reconciliation_disk_results = 0 nlast_reconciliation_orphaned_datasets = 0 nlast_reconciliation_zone_results = 0 nnvme_disk_firmware = 0 nomicron_sled_config_datasets = 0 nomicron_sled_config_disks = 0 nomicron_sled_config_zone_nics = 0 nomicron_sled_config_zones = 0 nomicron_sled_configs = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agents = 0 nsps = 2 nzpools = 0
7692025-06-18T18:45:47.734ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7702025-06-18T18:45:47.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7712025-06-18T18:45:47.735ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7722025-06-18T18:45:47.771ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 213.82864ms iteration = 23 status = {"physical_disks_added":0}
7732025-06-18T18:45:47.779ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
7742025-06-18T18:45:47.779ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7752025-06-18T18:45:47.779ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b3399233-1360-4919-b2b8-6ffc05873b43", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7762025-06-18T18:45:47.779ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7772025-06-18T18:45:47.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7782025-06-18T18:45:47.781ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "6045333f-d179-48b6-8cbc-b68b47156dc2", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7792025-06-18T18:45:47.781ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7802025-06-18T18:45:47.782ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
7812025-06-18T18:45:47.782ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 225.260518ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
7822025-06-18T18:45:47.841ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7832025-06-18T18:45:47.841ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7842025-06-18T18:45:47.841ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "552a1f1b-af2c-4b5d-9c50-55e243fa4983", "content-length": "372", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
7852025-06-18T18:45:47.841ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7862025-06-18T18:45:47.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7872025-06-18T18:45:47.874ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7882025-06-18T18:45:47.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7892025-06-18T18:45:47.895ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7902025-06-18T18:45:47.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7912025-06-18T18:45:47.897ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 340.146313ms iteration = 21 status = {}
7922025-06-18T18:45:47.948ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
7932025-06-18T18:45:47.992ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f zone_address = fd00:1122:3344:101::2
7942025-06-18T18:45:47.992ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7952025-06-18T18:45:47.992ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b58ba5f-0bb6-4409-8b74-27f4c70bce16", "content-length": "26", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
7962025-06-18T18:45:47.992ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7972025-06-18T18:45:47.994ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
7982025-06-18T18:45:48.030ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
7992025-06-18T18:45:48.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
8002025-06-18T18:45:48.032ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8012025-06-18T18:45:48.032ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8022025-06-18T18:45:48.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8032025-06-18T18:45:48.034ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8042025-06-18T18:45:48.034ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8052025-06-18T18:45:48.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8062025-06-18T18:45:48.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8072025-06-18T18:45:48.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
8082025-06-18T18:45:48.035ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
8092025-06-18T18:45:48.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
8102025-06-18T18:45:48.037ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
8112025-06-18T18:45:48.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
8122025-06-18T18:45:48.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
8132025-06-18T18:45:48.038ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
8142025-06-18T18:45:48.038ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8152025-06-18T18:45:48.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8162025-06-18T18:45:48.040ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8172025-06-18T18:45:48.042ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 484.530554ms iteration = 21 status = null
8182025-06-18T18:45:48.042ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8192025-06-18T18:45:48.042ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8202025-06-18T18:45:48.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8212025-06-18T18:45:48.044ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8222025-06-18T18:45:48.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9fbbc826-5b83-4b80-8172-66302c618aae, lookup_type: ById(9fbbc826-5b83-4b80-8172-66302c618aae) } result = Ok(())
8232025-06-18T18:45:48.048ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8242025-06-18T18:45:48.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8252025-06-18T18:45:48.050ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(812e1124-e017-4b14-8482-7fcb648056b2, 0), (317e8971-fb2e-498c-a913-cadefa993520, 0), (b362ccd3-b8a9-4eac-bf74-70f09bcb7bad, 0)]
8262025-06-18T18:45:48.053ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1537, tv_nsec: 635141122 } })
8272025-06-18T18:45:48.057ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 499.958088ms iteration = 21 status = 0
8282025-06-18T18:45:48.083ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8292025-06-18T18:45:48.085ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8302025-06-18T18:45:48.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8312025-06-18T18:45:48.087ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
8322025-06-18T18:45:48.087ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8332025-06-18T18:45:48.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8342025-06-18T18:45:48.087ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8352025-06-18T18:45:48.087ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
8362025-06-18T18:45:48.087ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
8372025-06-18T18:45:48.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
8382025-06-18T18:45:48.088ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
8392025-06-18T18:45:48.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
8402025-06-18T18:45:48.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
8412025-06-18T18:45:48.089ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8422025-06-18T18:45:48.089ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
8432025-06-18T18:45:48.089ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8442025-06-18T18:45:48.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
8452025-06-18T18:45:48.090ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
8462025-06-18T18:45:48.090ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 72dd4529-6655-4d30-a1d8-0de429d0133c dns_zone_name = oxide.test found_so_far = 0 version = 2
8472025-06-18T18:45:48.090ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8482025-06-18T18:45:48.090ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
8492025-06-18T18:45:48.090ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8502025-06-18T18:45:48.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8512025-06-18T18:45:48.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8522025-06-18T18:45:48.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
8532025-06-18T18:45:48.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
8542025-06-18T18:45:48.091ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8552025-06-18T18:45:48.091ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8562025-06-18T18:45:48.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8572025-06-18T18:45:48.093ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
8582025-06-18T18:45:48.093ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 535.798662ms iteration = 21 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
8592025-06-18T18:45:48.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
8602025-06-18T18:45:48.095ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8612025-06-18T18:45:48.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8622025-06-18T18:45:48.095ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
8632025-06-18T18:45:48.095ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
8642025-06-18T18:45:48.095ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0ad6b179-89cb-4195-9c8d-5d013d7bd8e4", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
8652025-06-18T18:45:48.095ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8662025-06-18T18:45:48.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8672025-06-18T18:45:48.096ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8682025-06-18T18:45:48.097ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8692025-06-18T18:45:48.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8702025-06-18T18:45:48.099ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8712025-06-18T18:45:48.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8722025-06-18T18:45:48.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
8732025-06-18T18:45:48.100ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8742025-06-18T18:45:48.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8752025-06-18T18:45:48.102ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 72dd4529-6655-4d30-a1d8-0de429d0133c dns_zone_name = oxide.test found_so_far = 4 version = 2
8762025-06-18T18:45:48.102ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
8772025-06-18T18:45:48.102ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-18 18:36:20.010620 UTC dns_group = external generation = 2
8782025-06-18T18:45:48.102ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 545.207622ms iteration = 11 status = {"generation":2}
8792025-06-18T18:45:48.102ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8802025-06-18T18:45:48.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8812025-06-18T18:45:48.105ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
8822025-06-18T18:45:48.105ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8832025-06-18T18:45:48.105ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6d2e9414-b154-4bc0-9b97-e9eef4141f5b", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
8842025-06-18T18:45:48.107ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 550.080339ms iteration = 21 status = {}
8852025-06-18T18:45:48.110ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
8862025-06-18T18:45:48.110ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "17fff0ed-c961-45f4-9dbe-683d112ff5ea", "date": "Wed, 18 Jun 2025 18:45:48 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
8872025-06-18T18:45:48.110ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
8882025-06-18T18:45:48.112ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3fac32a9-7428-44f1-a166-eada58e9c982", "date": "Wed, 18 Jun 2025 18:45:48 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
8892025-06-18T18:45:48.112ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
8902025-06-18T18:45:48.114ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "43fc5680-359e-4fad-b36c-dbb4f72e0033", "date": "Wed, 18 Jun 2025 18:45:48 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
8912025-06-18T18:45:48.114ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
8922025-06-18T18:45:48.119ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
8932025-06-18T18:45:48.120ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 562.772924ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
8942025-06-18T18:45:48.132ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
8952025-06-18T18:45:48.132ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = ab8dd933-5e45-404d-97a3-fdafa1c7d91b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
8962025-06-18T18:45:48.132ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8972025-06-18T18:45:48.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8982025-06-18T18:45:48.134ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8992025-06-18T18:45:48.134ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9002025-06-18T18:45:48.135ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-18T18:35:46.206089Z, time_modified: 2025-06-18T18:35:46.206089Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 472c0288-095b-456c-b18f-d5f22a8efd72, db_silo: Silo { identity: SiloIdentity { id: 472c0288-095b-456c-b18f-d5f22a8efd72, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-18T18:36:19.955323Z, time_modified: 2025-06-18T18:36:19.955323Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 472c0288-095b-456c-b18f-d5f22a8efd72, db_silo: Silo { identity: SiloIdentity { id: 472c0288-095b-456c-b18f-d5f22a8efd72, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-18T18:36:19.955323Z, time_modified: 2025-06-18T18:36:19.955323Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3" }] }) }
9012025-06-18T18:45:48.135ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 578.038595ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"472c0288-095b-456c-b18f-d5f22a8efd72","tls_certs":["6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3"]}},"default_endpoint":{"silo_id":"472c0288-095b-456c-b18f-d5f22a8efd72","tls_certs":["6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
9022025-06-18T18:45:48.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
9032025-06-18T18:45:48.136ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
9042025-06-18T18:45:48.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
9052025-06-18T18:45:48.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
9062025-06-18T18:45:48.138ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
9072025-06-18T18:45:48.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
9082025-06-18T18:45:48.138ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9092025-06-18T18:45:48.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9102025-06-18T18:45:48.139ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/artifacts-config
9112025-06-18T18:45:48.140ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts-config", status: 204, headers: {"x-request-id": "18e25cb8-d0b6-45a6-b64d-44602890b20e", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
9122025-06-18T18:45:48.140ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
9132025-06-18T18:45:48.140ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = ab8dd933-5e45-404d-97a3-fdafa1c7d91b dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
9142025-06-18T18:45:48.140ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
9152025-06-18T18:45:48.140ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-18 18:36:19.303122 UTC dns_group = internal generation = 1
9162025-06-18T18:45:48.140ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 582.78044ms iteration = 11 status = {"generation":1}
9172025-06-18T18:45:48.140ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "94604c7b-e163-42c1-b32d-e1fb165006f8", "content-length": "26", "date": "Wed, 18 Jun 2025 18:45:48 GMT"} })
9182025-06-18T18:45:48.140ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:669 sled = http://[fd00:1122:3344:101::1]:12345
9192025-06-18T18:45:48.143ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9202025-06-18T18:45:48.144ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 587.281182ms iteration = 3 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":2,"put_config_err":0,"put_config_ok":2,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"9fbbc826-5b83-4b80-8172-66302c618aae","time":"2025-06-18T18:40:48.065222500Z"},{"operation":"list","target_sled":"9fbbc826-5b83-4b80-8172-66302c618aae","time":"2025-06-18T18:40:48.073988061Z"},{"generation":1,"operation":"put_config","target_sled":"9fbbc826-5b83-4b80-8172-66302c618aae","time":"2025-06-18T18:45:48.140141520Z"},{"operation":"list","target_sled":"9fbbc826-5b83-4b80-8172-66302c618aae","time":"2025-06-18T18:45:48.140424074Z"}]}
9212025-06-18T18:45:48.145ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9222025-06-18T18:45:48.146ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
9232025-06-18T18:45:48.146ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
9242025-06-18T18:45:48.146ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
9252025-06-18T18:45:48.146ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc9758b3-a661-496f-8677-0991808326c9", "content-length": "476", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
9262025-06-18T18:45:48.146ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
9272025-06-18T18:45:48.146ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4548b549-c5d4-484c-a2cb-fc6e73e602b3", "content-length": "734", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
9282025-06-18T18:45:48.146ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
9292025-06-18T18:45:48.147ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "21f00539-3c17-405b-b5cf-3c22b210c240", "content-length": "111", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
9302025-06-18T18:45:48.147ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
9312025-06-18T18:45:48.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
9322025-06-18T18:45:48.147ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "772ee379-d0f6-4d1c-be34-519f9a3459a7", "content-length": "111", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
9332025-06-18T18:45:48.147ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9342025-06-18T18:45:48.147ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
9352025-06-18T18:45:48.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9362025-06-18T18:45:48.147ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b5f92f3-b413-40f3-ae39-b94ca58daaba", "content-length": "170", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
9372025-06-18T18:45:48.147ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
9382025-06-18T18:45:48.147ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
9392025-06-18T18:45:48.147ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
9402025-06-18T18:45:48.147ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa7e3c1e-07a7-4ebd-8b8f-a9b3734b9684", "content-length": "170", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
9412025-06-18T18:45:48.147ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
9422025-06-18T18:45:48.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
9432025-06-18T18:45:48.148ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "851221e8-5423-410f-9875-9e36ab57bc3c", "content-length": "179", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
9442025-06-18T18:45:48.148ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
9452025-06-18T18:45:48.148ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b568021b-656e-4fd8-8316-b7d8d3151945", "content-length": "179", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
9462025-06-18T18:45:48.148ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
9472025-06-18T18:45:48.148ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "37f55543-f5dd-4379-b138-fcaa27fa397c", "content-length": "702", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
9482025-06-18T18:45:48.148ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
9492025-06-18T18:45:48.148ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4a77d59-7f3c-4b50-b7fe-fc8ecd326838", "content-length": "727", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
9502025-06-18T18:45:48.148ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
9512025-06-18T18:45:48.148ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5452a44-bcb5-4c3e-a444-f992a16d65ef", "content-length": "729", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
9522025-06-18T18:45:48.148ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
9532025-06-18T18:45:48.149ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0de835f6-fbb8-4378-a586-9eb73fd23c24", "content-length": "728", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
9542025-06-18T18:45:48.149ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
9552025-06-18T18:45:48.149ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "366f39de-d7b4-4979-b3ae-950193f1a1c5", "content-length": "722", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
9562025-06-18T18:45:48.149ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
9572025-06-18T18:45:48.149ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6876c11f-d158-47d2-92f1-87c9f5e2beac", "content-length": "109", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
9582025-06-18T18:45:48.149ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
9592025-06-18T18:45:48.149ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ed1dcf9-c179-48d4-afaa-de4398515bf4", "content-length": "109", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
9602025-06-18T18:45:48.149ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
9612025-06-18T18:45:48.149ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9622025-06-18T18:45:48.150ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "54593e93-ed3f-4134-adbf-1055f5596b55", "content-length": "169", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
9632025-06-18T18:45:48.150ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
9642025-06-18T18:45:48.150ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9652025-06-18T18:45:48.150ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "90918105-f029-433a-b76d-b4cfc459bdfe", "content-length": "169", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
9662025-06-18T18:45:48.150ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
9672025-06-18T18:45:48.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9682025-06-18T18:45:48.150ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "faf670ce-4798-4e19-9860-827cfd37821d", "content-length": "178", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
9692025-06-18T18:45:48.150ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
9702025-06-18T18:45:48.150ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7f2e15c-d66e-4131-8be9-4aa9765d5877", "content-length": "178", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
9712025-06-18T18:45:48.150ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
9722025-06-18T18:45:48.151ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5329ef4c-67e7-4659-9ffa-f8d015b4f5a2", "content-length": "702", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
9732025-06-18T18:45:48.151ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
9742025-06-18T18:45:48.151ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "64b1a585-1624-4419-bc7f-8d11903ec5f0", "content-length": "727", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
9752025-06-18T18:45:48.151ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
9762025-06-18T18:45:48.151ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "63cca1e9-611e-450a-bdeb-edf6f46c1661", "content-length": "729", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
9772025-06-18T18:45:48.151ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
9782025-06-18T18:45:48.151ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8af2597a-a35f-4f70-b566-bdba8afaa764", "content-length": "728", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
9792025-06-18T18:45:48.151ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9802025-06-18T18:45:48.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9812025-06-18T18:45:48.151ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
9822025-06-18T18:45:48.151ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
9832025-06-18T18:45:48.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
9842025-06-18T18:45:48.152ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9852025-06-18T18:45:48.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9862025-06-18T18:45:48.153ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9872025-06-18T18:45:48.154ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9882025-06-18T18:45:48.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9892025-06-18T18:45:48.155ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
9902025-06-18T18:45:48.155ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 597.777827ms iteration = 5 status = {"blueprint_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","inventory_collection_id":"b362ccd3-b8a9-4eac-bf74-70f09bcb7bad","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
9912025-06-18T18:45:48.155ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
9922025-06-18T18:45:48.155ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9932025-06-18T18:45:48.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9942025-06-18T18:45:48.157ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9952025-06-18T18:45:48.157ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9962025-06-18T18:45:48.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9972025-06-18T18:45:48.159ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
9982025-06-18T18:45:48.159ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9992025-06-18T18:45:48.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10002025-06-18T18:45:48.160ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10012025-06-18T18:45:48.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10022025-06-18T18:45:48.161ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10032025-06-18T18:45:48.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10042025-06-18T18:45:48.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10052025-06-18T18:45:48.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10062025-06-18T18:45:48.175ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 7e1ff921-047f-464e-8081-f8132af716ac, rack_id: 3a330d2e-6212-46a4-9781-374fdb3dc92f, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(6c07c314-d66b-4041-9040-d774200d26a9) } rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
10072025-06-18T18:45:48.175ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10082025-06-18T18:45:48.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10092025-06-18T18:45:48.186ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
10102025-06-18T18:45:48.186ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 629.209551ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
10112025-06-18T18:45:48.187ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
10122025-06-18T18:45:48.187ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 6c07c314-d66b-4041-9040-d774200d26a9
10132025-06-18T18:45:48.187ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
10142025-06-18T18:45:48.187ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
10152025-06-18T18:45:48.187ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10162025-06-18T18:45:48.187ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10172025-06-18T18:45:48.187ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10182025-06-18T18:45:48.187ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
10192025-06-18T18:45:48.188ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10202025-06-18T18:45:48.188ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
10212025-06-18T18:45:48.188ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
10222025-06-18T18:45:48.188ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10232025-06-18T18:45:48.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10242025-06-18T18:45:48.191ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
10252025-06-18T18:45:48.191ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
10262025-06-18T18:45:48.202ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10272025-06-18T18:45:48.203ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
10282025-06-18T18:45:48.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
10292025-06-18T18:45:48.207ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10302025-06-18T18:45:48.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10312025-06-18T18:45:48.209ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10322025-06-18T18:45:48.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10332025-06-18T18:45:48.212ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10342025-06-18T18:45:48.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10352025-06-18T18:45:48.214ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10362025-06-18T18:45:48.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10372025-06-18T18:45:48.217ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10382025-06-18T18:45:48.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10392025-06-18T18:45:48.219ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10402025-06-18T18:45:48.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10412025-06-18T18:45:48.221ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10422025-06-18T18:45:48.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10432025-06-18T18:45:48.222ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10442025-06-18T18:45:48.226ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
10452025-06-18T18:45:48.226ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10462025-06-18T18:45:48.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10472025-06-18T18:45:48.259ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10482025-06-18T18:45:48.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10492025-06-18T18:45:48.264ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
10502025-06-18T18:45:48.264ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
10512025-06-18T18:45:48.266ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10522025-06-18T18:45:48.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10532025-06-18T18:45:48.268ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10542025-06-18T18:45:48.272ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
10552025-06-18T18:45:48.272ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10562025-06-18T18:45:48.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10572025-06-18T18:45:48.276ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10582025-06-18T18:45:48.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10592025-06-18T18:45:48.278ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10602025-06-18T18:45:48.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10612025-06-18T18:45:48.281ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10622025-06-18T18:45:48.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10632025-06-18T18:45:48.283ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10642025-06-18T18:45:48.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10652025-06-18T18:45:48.286ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10662025-06-18T18:45:48.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10672025-06-18T18:45:48.287ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10682025-06-18T18:45:48.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10692025-06-18T18:45:48.289ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10702025-06-18T18:45:48.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10712025-06-18T18:45:48.291ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10722025-06-18T18:45:48.295ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
10732025-06-18T18:45:48.295ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10742025-06-18T18:45:48.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10752025-06-18T18:45:48.316ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f68bfcb2-8f76-4e17-8f3d-b01b7c4973ac", "date": "Wed, 18 Jun 2025 18:45:48 GMT"} })
10762025-06-18T18:45:48.316ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch = Switch0
10772025-06-18T18:45:48.316ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
10782025-06-18T18:45:48.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4d3d6d2f-0918-4f00-802e-cd971577ec41 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
10792025-06-18T18:45:48.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4d3d6d2f-0918-4f00-802e-cd971577ec41 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
10802025-06-18T18:45:48.318ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc3833dd-134b-4c2c-b7fd-0db29084445b", "content-length": "682", "date": "Wed, 18 Jun 2025 18:45:47 GMT"} })
10812025-06-18T18:45:48.318ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10822025-06-18T18:45:48.318ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "813ac5a2-ea80-4535-9a42-ee272d312b0a", "content-length": "691", "date": "Wed, 18 Jun 2025 18:45:48 GMT"} })
10832025-06-18T18:45:48.318ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
10842025-06-18T18:45:48.318ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
10852025-06-18T18:45:48.318ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
10862025-06-18T18:45:48.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10872025-06-18T18:45:48.320ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 763.826968ms iteration = 21 status = {}
10882025-06-18T18:45:48.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 5576 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4d3d6d2f-0918-4f00-802e-cd971577ec41 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
10892025-06-18T18:45:48.336ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10902025-06-18T18:45:48.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10912025-06-18T18:45:48.341ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10922025-06-18T18:45:48.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10932025-06-18T18:45:48.344ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10942025-06-18T18:45:48.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10952025-06-18T18:45:48.354ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 796.987935ms iteration = 21 status = {}
10962025-06-18T18:45:48.365ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10972025-06-18T18:45:48.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10982025-06-18T18:45:48.368ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10992025-06-18T18:45:48.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11002025-06-18T18:45:48.370ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11012025-06-18T18:45:48.376ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
11022025-06-18T18:45:48.376ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11032025-06-18T18:45:48.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11042025-06-18T18:45:48.384ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 4c3f65cf-097e-4f7f-bcbd-fe4a69c72380, kind: Service { id: 800703b5-0601-4ce2-acc3-d5b9ca473160 }, name: Name("external-dns-800703b5-0601-4ce2-acc3-d5b9ca473160"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 125])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8257c735-9403-467d-ab2e-1949faf5e7da, kind: Service { id: 03fce462-e4e1-4a86-890b-8a2ae9e17168 }, name: Name("external-dns-03fce462-e4e1-4a86-890b-8a2ae9e17168"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 1b4a3441-8faf-4189-b360-7390987e22a5, kind: Service { id: bc9fb17d-ee0d-4316-a104-8c90282fc043 }, name: Name("nexus-bc9fb17d-ee0d-4316-a104-8c90282fc043"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 17])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bd40f9d4-e706-42d1-8343-14cc7ebb9a67, kind: Service { id: bd650381-2ec2-42b7-9e94-5fda37d951b8 }, name: Name("nexus-bd650381-2ec2-42b7-9e94-5fda37d951b8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 116])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e32c28c4-67a7-4997-8fc5-f30c60e72322, kind: Service { id: 8be6515c-b7f8-4e94-8553-063002d39ea6 }, name: Name("nexus-8be6515c-b7f8-4e94-8553-063002d39ea6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
11052025-06-18T18:45:48.385ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11062025-06-18T18:45:48.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11072025-06-18T18:45:48.387ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11082025-06-18T18:45:48.391ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e67d707-f38e-4996-a95b-d55ce58e9318", "content-length": "87718", "date": "Wed, 18 Jun 2025 18:45:48 GMT"} })
11092025-06-18T18:45:48.391ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
11102025-06-18T18:45:48.391ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11112025-06-18T18:45:48.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11122025-06-18T18:45:48.395ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
11132025-06-18T18:45:48.395ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
11142025-06-18T18:45:48.395ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
11152025-06-18T18:45:48.398ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
11162025-06-18T18:45:48.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
11172025-06-18T18:45:48.399ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
11182025-06-18T18:45:48.399ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4c3f65cf-097e-4f7f-bcbd-fe4a69c72380, kind: Service { id: 800703b5-0601-4ce2-acc3-d5b9ca473160 }, name: Name("external-dns-800703b5-0601-4ce2-acc3-d5b9ca473160"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 125])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8257c735-9403-467d-ab2e-1949faf5e7da, kind: Service { id: 03fce462-e4e1-4a86-890b-8a2ae9e17168 }, name: Name("external-dns-03fce462-e4e1-4a86-890b-8a2ae9e17168"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 1b4a3441-8faf-4189-b360-7390987e22a5, kind: Service { id: bc9fb17d-ee0d-4316-a104-8c90282fc043 }, name: Name("nexus-bc9fb17d-ee0d-4316-a104-8c90282fc043"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 17])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bd40f9d4-e706-42d1-8343-14cc7ebb9a67, kind: Service { id: bd650381-2ec2-42b7-9e94-5fda37d951b8 }, name: Name("nexus-bd650381-2ec2-42b7-9e94-5fda37d951b8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 116])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e32c28c4-67a7-4997-8fc5-f30c60e72322, kind: Service { id: 8be6515c-b7f8-4e94-8553-063002d39ea6 }, name: Name("nexus-8be6515c-b7f8-4e94-8553-063002d39ea6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
11192025-06-18T18:45:48.399ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
11202025-06-18T18:45:48.401ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11212025-06-18T18:45:48.405ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
11222025-06-18T18:45:48.405ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
11232025-06-18T18:45:48.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
11242025-06-18T18:45:48.498ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 9fbbc826-5b83-4b80-8172-66302c618aae, time_created: 2025-06-18T18:36:18.987238Z, time_modified: 2025-06-18T18:36:18.987238Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 3a330d2e-6212-46a4-9781-374fdb3dc92f, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(56094621696)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
11252025-06-18T18:45:48.498ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
11262025-06-18T18:45:48.536ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11272025-06-18T18:45:48.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11282025-06-18T18:45:48.539ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
11292025-06-18T18:45:48.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
11302025-06-18T18:45:48.541ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11312025-06-18T18:45:48.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 9fbbc826-5b83-4b80-8172-66302c618aae, lookup_type: ById(9fbbc826-5b83-4b80-8172-66302c618aae) } result = Ok(())
11322025-06-18T18:45:48.545ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
11332025-06-18T18:45:48.546ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "1842e0ac-efa5-4a7e-b1c5-d155a2b5573f", "date": "Wed, 18 Jun 2025 18:45:48 GMT"} })
11342025-06-18T18:45:48.547ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:495
11352025-06-18T18:45:48.547ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 990.402393ms
11362025-06-18T18:45:48.547ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 990.410843ms iteration = 3 status = {}
11372025-06-18T18:45:48.676ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = adf8a9d4-6dd4-4ed4-a8aa-4f3391cbb5a2 file = nexus/db-queries/src/db/datastore/inventory.rs:1216
11382025-06-18T18:45:48.676ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = adf8a9d4-6dd4-4ed4-a8aa-4f3391cbb5a2 time_started = 2025-06-18 18:45:48.146030 UTC
11392025-06-18T18:45:48.676ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 6 reason = Dependency
11402025-06-18T18:45:48.676ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
11412025-06-18T18:45:48.676ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.118670083s iteration = 3 status = {"collection_id":"adf8a9d4-6dd4-4ed4-a8aa-4f3391cbb5a2","time_done":"2025-06-18 18:45:48.395484 UTC","time_started":"2025-06-18 18:45:48.146030 UTC"}
11422025-06-18T18:45:48.676ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
11432025-06-18T18:45:48.676ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11442025-06-18T18:45:48.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11452025-06-18T18:45:48.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
11462025-06-18T18:45:48.680ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11472025-06-18T18:45:48.681ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11482025-06-18T18:45:48.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11492025-06-18T18:45:48.684ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11502025-06-18T18:45:48.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11512025-06-18T18:45:48.684ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
11522025-06-18T18:45:48.684ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
11532025-06-18T18:45:48.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
11542025-06-18T18:45:48.686ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
11552025-06-18T18:45:48.686ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11562025-06-18T18:45:48.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
11572025-06-18T18:45:48.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11582025-06-18T18:45:48.689ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11592025-06-18T18:45:48.692ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11602025-06-18T18:45:48.692ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11612025-06-18T18:45:48.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11622025-06-18T18:45:48.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
11632025-06-18T18:45:48.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
11642025-06-18T18:45:48.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11652025-06-18T18:45:48.739ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
11662025-06-18T18:45:48.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
11672025-06-18T18:45:48.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
11682025-06-18T18:45:48.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11692025-06-18T18:45:48.743ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
11702025-06-18T18:45:48.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
11712025-06-18T18:45:48.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
11722025-06-18T18:45:48.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
11732025-06-18T18:45:48.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
11742025-06-18T18:45:48.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11752025-06-18T18:45:48.749ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 73.15606ms iteration = 24 status = {"physical_disks_added":0}
11762025-06-18T18:45:48.751ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
11772025-06-18T18:45:48.751ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
11782025-06-18T18:45:48.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
11792025-06-18T18:45:48.753ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11802025-06-18T18:45:48.755ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
11812025-06-18T18:45:48.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
11822025-06-18T18:45:48.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
11832025-06-18T18:45:48.758ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
11842025-06-18T18:45:48.758ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 82.427337ms iteration = 6 status = {"blueprint_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","inventory_collection_id":"adf8a9d4-6dd4-4ed4-a8aa-4f3391cbb5a2","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
11852025-06-18T18:45:49.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 45700384-e4bd-469c-9129-38a37452e21b roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
11862025-06-18T18:45:49.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 45700384-e4bd-469c-9129-38a37452e21b resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
11872025-06-18T18:45:49.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2594 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 45700384-e4bd-469c-9129-38a37452e21b response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
11882025-06-18T18:45:50.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3ba67102-8c64-4dee-96e7-1bbe0ec33969 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
11892025-06-18T18:45:50.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3ba67102-8c64-4dee-96e7-1bbe0ec33969 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
11902025-06-18T18:45:50.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2724 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3ba67102-8c64-4dee-96e7-1bbe0ec33969 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
11912025-06-18T18:45:51.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = 4a5fc61e-6d79-44ac-89d3-f1c96b1b1e21 roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
11922025-06-18T18:45:51.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = 4a5fc61e-6d79-44ac-89d3-f1c96b1b1e21 resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
11932025-06-18T18:45:51.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3757 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = 4a5fc61e-6d79-44ac-89d3-f1c96b1b1e21 response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
11942025-06-18T18:45:51.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = 171c51be-f12b-4523-b9fb-ccf9ff8e5c57 roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
11952025-06-18T18:45:51.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = 171c51be-f12b-4523-b9fb-ccf9ff8e5c57 resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
11962025-06-18T18:45:51.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2685 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = 171c51be-f12b-4523-b9fb-ccf9ff8e5c57 response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
11972025-06-18T18:45:51.131ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 498 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = dc0295cb-e4f9-46bf-b395-7ad5633037c3 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
11982025-06-18T18:45:51.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 42b68037-e35b-40ae-9dd0-b8babf7aabfa roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
11992025-06-18T18:45:51.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 42b68037-e35b-40ae-9dd0-b8babf7aabfa resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12002025-06-18T18:45:51.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1977 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 42b68037-e35b-40ae-9dd0-b8babf7aabfa response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12012025-06-18T18:45:52.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5518d6e3-4b67-4ad9-84cd-97f5fcdd3a73 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12022025-06-18T18:45:52.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5518d6e3-4b67-4ad9-84cd-97f5fcdd3a73 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12032025-06-18T18:45:52.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2219 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5518d6e3-4b67-4ad9-84cd-97f5fcdd3a73 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12042025-06-18T18:45:53.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 14ba25c7-306d-4797-aba7-67bbe35852e6 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12052025-06-18T18:45:53.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 14ba25c7-306d-4797-aba7-67bbe35852e6 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12062025-06-18T18:45:53.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2175 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 14ba25c7-306d-4797-aba7-67bbe35852e6 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12072025-06-18T18:45:54.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 2268c5f8-fe6d-4f0f-a125-fe0fc1b18430 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12082025-06-18T18:45:54.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 2268c5f8-fe6d-4f0f-a125-fe0fc1b18430 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12092025-06-18T18:45:54.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2444 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 2268c5f8-fe6d-4f0f-a125-fe0fc1b18430 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12102025-06-18T18:45:55.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 78f24dd2-d61d-4259-84c6-adbfc557edef roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12112025-06-18T18:45:55.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 78f24dd2-d61d-4259-84c6-adbfc557edef resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12122025-06-18T18:45:55.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2808 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 78f24dd2-d61d-4259-84c6-adbfc557edef response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12132025-06-18T18:45:56.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4c23f7ac-e562-4e6f-b2b2-34e85d4c6e5b roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12142025-06-18T18:45:56.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4c23f7ac-e562-4e6f-b2b2-34e85d4c6e5b resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12152025-06-18T18:45:56.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2226 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4c23f7ac-e562-4e6f-b2b2-34e85d4c6e5b response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12162025-06-18T18:45:57.484ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 09814a22-759e-4086-9818-89d7361ddd3c roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12172025-06-18T18:45:57.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 09814a22-759e-4086-9818-89d7361ddd3c resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12182025-06-18T18:45:57.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1887 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 09814a22-759e-4086-9818-89d7361ddd3c response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12192025-06-18T18:45:57.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
12202025-06-18T18:45:57.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
12212025-06-18T18:45:57.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12222025-06-18T18:45:57.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12232025-06-18T18:45:57.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12242025-06-18T18:45:57.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12252025-06-18T18:45:57.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12262025-06-18T18:45:57.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12272025-06-18T18:45:57.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12282025-06-18T18:45:57.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12292025-06-18T18:45:57.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12302025-06-18T18:45:57.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12312025-06-18T18:45:57.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12322025-06-18T18:45:57.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
12332025-06-18T18:45:57.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12342025-06-18T18:45:57.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12352025-06-18T18:45:57.579ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
12362025-06-18T18:45:57.579ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.306828ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
12372025-06-18T18:45:57.590ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12382025-06-18T18:45:57.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12392025-06-18T18:45:57.623ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.019761ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12402025-06-18T18:45:58.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ae179e9f-bac4-4e0c-8934-c13f47c58391 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12412025-06-18T18:45:58.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ae179e9f-bac4-4e0c-8934-c13f47c58391 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12422025-06-18T18:45:58.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2340 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ae179e9f-bac4-4e0c-8934-c13f47c58391 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12432025-06-18T18:45:59.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1267bfad-1920-4b34-bce4-c4feef4b068f roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12442025-06-18T18:45:59.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1267bfad-1920-4b34-bce4-c4feef4b068f resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12452025-06-18T18:45:59.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2209 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1267bfad-1920-4b34-bce4-c4feef4b068f response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12462025-06-18T18:46:00.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 94ab0ddd-86eb-4c9b-ae74-71a8a684d93d roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12472025-06-18T18:46:00.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 94ab0ddd-86eb-4c9b-ae74-71a8a684d93d resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12482025-06-18T18:46:00.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1879 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 94ab0ddd-86eb-4c9b-ae74-71a8a684d93d response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12492025-06-18T18:46:01.132ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 890 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 302082ee-711d-4211-af9f-bfea94be5bd8 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
12502025-06-18T18:46:01.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9d651be2-c85d-4bd1-9404-52b08d529479 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12512025-06-18T18:46:01.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9d651be2-c85d-4bd1-9404-52b08d529479 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12522025-06-18T18:46:01.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2362 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9d651be2-c85d-4bd1-9404-52b08d529479 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12532025-06-18T18:46:02.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3179eb3b-c5cd-45e2-8897-2bc587b51e5e roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12542025-06-18T18:46:02.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3179eb3b-c5cd-45e2-8897-2bc587b51e5e resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12552025-06-18T18:46:02.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2705 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3179eb3b-c5cd-45e2-8897-2bc587b51e5e response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12562025-06-18T18:46:03.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c8c7879e-1995-44b2-8c2a-c992a5b4b5f3 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12572025-06-18T18:46:03.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c8c7879e-1995-44b2-8c2a-c992a5b4b5f3 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12582025-06-18T18:46:03.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2591 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c8c7879e-1995-44b2-8c2a-c992a5b4b5f3 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12592025-06-18T18:46:04.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bc1e5f07-e4e2-4389-aff0-6d9ec05694c5 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12602025-06-18T18:46:04.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bc1e5f07-e4e2-4389-aff0-6d9ec05694c5 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12612025-06-18T18:46:04.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2314 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bc1e5f07-e4e2-4389-aff0-6d9ec05694c5 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12622025-06-18T18:46:05.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9f9c57be-71c0-4045-aeb6-82625e8c5cbb roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12632025-06-18T18:46:05.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9f9c57be-71c0-4045-aeb6-82625e8c5cbb resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12642025-06-18T18:46:05.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1819 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9f9c57be-71c0-4045-aeb6-82625e8c5cbb response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12652025-06-18T18:46:06.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = 56fe864a-849b-4216-8f43-5835ab2dd237 roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
12662025-06-18T18:46:06.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = 56fe864a-849b-4216-8f43-5835ab2dd237 resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
12672025-06-18T18:46:06.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3274 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = 56fe864a-849b-4216-8f43-5835ab2dd237 response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
12682025-06-18T18:46:06.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = 59c0bede-1fe9-476a-99a1-249e07803a51 roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
12692025-06-18T18:46:06.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = 59c0bede-1fe9-476a-99a1-249e07803a51 resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
12702025-06-18T18:46:06.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2000 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = 59c0bede-1fe9-476a-99a1-249e07803a51 response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
12712025-06-18T18:46:06.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 38b30e49-aa9f-4f3a-9d91-933910deffe6 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12722025-06-18T18:46:06.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 38b30e49-aa9f-4f3a-9d91-933910deffe6 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12732025-06-18T18:46:06.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2364 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 38b30e49-aa9f-4f3a-9d91-933910deffe6 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12742025-06-18T18:46:07.556ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
12752025-06-18T18:46:07.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12762025-06-18T18:46:07.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
12772025-06-18T18:46:07.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12782025-06-18T18:46:07.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12792025-06-18T18:46:07.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12802025-06-18T18:46:07.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12812025-06-18T18:46:07.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12822025-06-18T18:46:07.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12832025-06-18T18:46:07.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12842025-06-18T18:46:07.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12852025-06-18T18:46:07.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12862025-06-18T18:46:07.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12872025-06-18T18:46:07.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
12882025-06-18T18:46:07.573ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12892025-06-18T18:46:07.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12902025-06-18T18:46:07.587ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
12912025-06-18T18:46:07.587ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.43895ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
12922025-06-18T18:46:07.595ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12932025-06-18T18:46:07.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12942025-06-18T18:46:07.626ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.719052ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12952025-06-18T18:46:07.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cfec5261-cb55-4516-93c5-ba2b394a5a31 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12962025-06-18T18:46:07.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cfec5261-cb55-4516-93c5-ba2b394a5a31 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12972025-06-18T18:46:07.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1889 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cfec5261-cb55-4516-93c5-ba2b394a5a31 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12982025-06-18T18:46:08.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1e8cdd56-44a8-4800-9b27-5f6f2f2ff0bb roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
12992025-06-18T18:46:08.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1e8cdd56-44a8-4800-9b27-5f6f2f2ff0bb resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13002025-06-18T18:46:08.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2698 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1e8cdd56-44a8-4800-9b27-5f6f2f2ff0bb response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13012025-06-18T18:46:09.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a986dcea-e020-4d87-9d05-afa312b42d90 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13022025-06-18T18:46:09.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a986dcea-e020-4d87-9d05-afa312b42d90 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13032025-06-18T18:46:09.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2054 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a986dcea-e020-4d87-9d05-afa312b42d90 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13042025-06-18T18:46:10.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8e819d24-9761-4654-91f5-628f02ca73f1 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13052025-06-18T18:46:10.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8e819d24-9761-4654-91f5-628f02ca73f1 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13062025-06-18T18:46:10.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2207 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8e819d24-9761-4654-91f5-628f02ca73f1 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13072025-06-18T18:46:11.131ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 683 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 5fcb1947-83f6-4df6-b3a9-8e003ce84889 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
13082025-06-18T18:46:11.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = baf367fe-e96e-403b-a7c6-d4d983af8d07 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13092025-06-18T18:46:11.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = baf367fe-e96e-403b-a7c6-d4d983af8d07 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13102025-06-18T18:46:11.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2388 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = baf367fe-e96e-403b-a7c6-d4d983af8d07 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13112025-06-18T18:46:12.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4889c1dc-7a75-4b3e-9b5a-adc024c27d12 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13122025-06-18T18:46:12.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4889c1dc-7a75-4b3e-9b5a-adc024c27d12 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13132025-06-18T18:46:12.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3121 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4889c1dc-7a75-4b3e-9b5a-adc024c27d12 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13142025-06-18T18:46:13.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4f2e5b9d-57a5-45e8-bf5c-1271efe9a46e roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13152025-06-18T18:46:13.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4f2e5b9d-57a5-45e8-bf5c-1271efe9a46e resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13162025-06-18T18:46:13.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1678 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4f2e5b9d-57a5-45e8-bf5c-1271efe9a46e response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13172025-06-18T18:46:14.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 41ee15ac-3b49-42bc-a71f-0e8aa891c99d roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13182025-06-18T18:46:14.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 41ee15ac-3b49-42bc-a71f-0e8aa891c99d resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13192025-06-18T18:46:14.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1803 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 41ee15ac-3b49-42bc-a71f-0e8aa891c99d response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13202025-06-18T18:46:15.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9f8657d7-4407-4a53-9b33-6f6cab34ceb5 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13212025-06-18T18:46:15.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9f8657d7-4407-4a53-9b33-6f6cab34ceb5 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13222025-06-18T18:46:15.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2392 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9f8657d7-4407-4a53-9b33-6f6cab34ceb5 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13232025-06-18T18:46:16.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 091dffe2-b588-481a-9f42-1ef9c08ed4fd roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13242025-06-18T18:46:16.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 091dffe2-b588-481a-9f42-1ef9c08ed4fd resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13252025-06-18T18:46:16.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2205 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 091dffe2-b588-481a-9f42-1ef9c08ed4fd response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
13262025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
13272025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13282025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
13292025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 22 reason = Timeout
13302025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13312025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13322025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 22 reason = Timeout
13332025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
13342025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
13352025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
13362025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
13372025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13382025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
13392025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13402025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13412025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
13422025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
13432025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
13442025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
13452025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13462025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
13472025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
13482025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13492025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13502025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
13512025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13522025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
13532025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13542025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
13552025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13562025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
13572025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
13582025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
13592025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13602025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
13612025-06-18T18:46:17.557ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
13622025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13632025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
13642025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13652025-06-18T18:46:17.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13662025-06-18T18:46:17.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13672025-06-18T18:46:17.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
13682025-06-18T18:46:17.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13692025-06-18T18:46:17.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
13702025-06-18T18:46:17.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
13712025-06-18T18:46:17.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
13722025-06-18T18:46:17.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
13732025-06-18T18:46:17.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13742025-06-18T18:46:17.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13752025-06-18T18:46:17.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
13762025-06-18T18:46:17.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13772025-06-18T18:46:17.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13782025-06-18T18:46:17.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13792025-06-18T18:46:17.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13802025-06-18T18:46:17.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
13812025-06-18T18:46:17.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13822025-06-18T18:46:17.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13832025-06-18T18:46:17.560ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13842025-06-18T18:46:17.560ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.88947ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
13852025-06-18T18:46:17.561ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13862025-06-18T18:46:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
13872025-06-18T18:46:17.562ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13882025-06-18T18:46:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
13892025-06-18T18:46:17.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
13902025-06-18T18:46:17.563ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13912025-06-18T18:46:17.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
13922025-06-18T18:46:17.565ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13932025-06-18T18:46:17.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
13942025-06-18T18:46:17.568ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13952025-06-18T18:46:17.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13962025-06-18T18:46:17.572ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1567, tv_nsec: 154167440 } })
13972025-06-18T18:46:17.572ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1567, tv_nsec: 154268031 } })
13982025-06-18T18:46:17.573ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
13992025-06-18T18:46:17.573ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
14002025-06-18T18:46:17.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14012025-06-18T18:46:17.576ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14022025-06-18T18:46:17.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14032025-06-18T18:46:17.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14042025-06-18T18:46:17.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14052025-06-18T18:46:17.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14062025-06-18T18:46:17.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14072025-06-18T18:46:17.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14082025-06-18T18:46:17.583ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14092025-06-18T18:46:17.584ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14102025-06-18T18:46:17.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14112025-06-18T18:46:17.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14122025-06-18T18:46:17.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14132025-06-18T18:46:17.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14142025-06-18T18:46:17.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14152025-06-18T18:46:17.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14162025-06-18T18:46:17.589ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14172025-06-18T18:46:17.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14182025-06-18T18:46:17.598ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14192025-06-18T18:46:17.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14202025-06-18T18:46:17.601ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 43.734173ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
14212025-06-18T18:46:17.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14222025-06-18T18:46:17.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14232025-06-18T18:46:17.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14242025-06-18T18:46:17.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14252025-06-18T18:46:17.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14262025-06-18T18:46:17.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14272025-06-18T18:46:17.606ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 48.638882ms iteration = 22 status = {"errors":[],"requests_created_ok":[]}
14282025-06-18T18:46:17.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.144668ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
14292025-06-18T18:46:17.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1567, tv_nsec: 188669056 } })
14302025-06-18T18:46:17.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
14312025-06-18T18:46:17.610ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
14322025-06-18T18:46:17.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
14332025-06-18T18:46:17.612ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14342025-06-18T18:46:17.613ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14352025-06-18T18:46:17.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14362025-06-18T18:46:17.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
14372025-06-18T18:46:17.614ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
14382025-06-18T18:46:17.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
14392025-06-18T18:46:17.616ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
14402025-06-18T18:46:17.616ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14412025-06-18T18:46:17.616ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14422025-06-18T18:46:17.616ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c00a8410-267f-4888-8cbf-48088b64ec8d", "content-length": "26", "date": "Wed, 18 Jun 2025 18:46:17 GMT"} })
14432025-06-18T18:46:17.616ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14442025-06-18T18:46:17.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14452025-06-18T18:46:17.617ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 59.627453ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14462025-06-18T18:46:17.617ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14472025-06-18T18:46:17.618ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14482025-06-18T18:46:17.618ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
14492025-06-18T18:46:17.618ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 60.674527ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
14502025-06-18T18:46:17.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14512025-06-18T18:46:17.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14522025-06-18T18:46:17.619ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14532025-06-18T18:46:17.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14542025-06-18T18:46:17.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14552025-06-18T18:46:17.620ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14562025-06-18T18:46:17.620ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14572025-06-18T18:46:17.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14582025-06-18T18:46:17.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14592025-06-18T18:46:17.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14602025-06-18T18:46:17.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9fbbc826-5b83-4b80-8172-66302c618aae, lookup_type: ById(9fbbc826-5b83-4b80-8172-66302c618aae) } result = Ok(())
14612025-06-18T18:46:17.624ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14622025-06-18T18:46:17.624ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14632025-06-18T18:46:17.624ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14642025-06-18T18:46:17.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14652025-06-18T18:46:17.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14662025-06-18T18:46:17.626ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14672025-06-18T18:46:17.626ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
14682025-06-18T18:46:17.626ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14692025-06-18T18:46:17.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14702025-06-18T18:46:17.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
14712025-06-18T18:46:17.629ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14722025-06-18T18:46:17.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14732025-06-18T18:46:17.630ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 72.894106ms iteration = 22 status = 0
14742025-06-18T18:46:17.640ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14752025-06-18T18:46:17.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14762025-06-18T18:46:17.642ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 84.700958ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14772025-06-18T18:46:17.642ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
14782025-06-18T18:46:17.642ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.632728ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
14792025-06-18T18:46:17.659ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
14802025-06-18T18:46:17.659ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 102.134039ms iteration = 22 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
14812025-06-18T18:46:17.661ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
14822025-06-18T18:46:17.661ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14832025-06-18T18:46:17.662ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a23ad0b9-58dd-4433-bb39-e46a7a121139", "content-length": "26", "date": "Wed, 18 Jun 2025 18:46:17 GMT"} })
14842025-06-18T18:46:17.662ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14852025-06-18T18:46:17.664ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14862025-06-18T18:46:17.666ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 108.458627ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14872025-06-18T18:46:17.669ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14882025-06-18T18:46:17.669ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
14892025-06-18T18:46:17.669ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14902025-06-18T18:46:17.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14912025-06-18T18:46:17.683ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 125.973258ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
14922025-06-18T18:46:17.696ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f zone_address = fd00:1122:3344:101::2
14932025-06-18T18:46:17.696ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14942025-06-18T18:46:17.696ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f56fe11-1e91-40c5-8299-dda14e12d899", "content-length": "26", "date": "Wed, 18 Jun 2025 18:46:17 GMT"} })
14952025-06-18T18:46:17.696ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14962025-06-18T18:46:17.698ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
14972025-06-18T18:46:17.710ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14982025-06-18T18:46:17.710ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
14992025-06-18T18:46:17.710ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 152.346142ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
15002025-06-18T18:46:17.710ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15012025-06-18T18:46:17.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15022025-06-18T18:46:17.712ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 154.562522ms iteration = 25 status = {"physical_disks_added":0}
15032025-06-18T18:46:17.750ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 192.769319ms iteration = 22 status = {}
15042025-06-18T18:46:17.792ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
15052025-06-18T18:46:17.792ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15062025-06-18T18:46:17.792ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d275429a-646e-4f36-9b22-a64ab8a3f74e", "content-length": "372", "date": "Wed, 18 Jun 2025 18:46:17 GMT"} })
15072025-06-18T18:46:17.792ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15082025-06-18T18:46:17.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15092025-06-18T18:46:17.793ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15102025-06-18T18:46:17.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15112025-06-18T18:46:17.795ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 237.73972ms iteration = 22 status = null
15122025-06-18T18:46:17.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e01956c2-7fdb-4ffc-954a-0f5395cfcaca roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
15132025-06-18T18:46:17.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e01956c2-7fdb-4ffc-954a-0f5395cfcaca resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
15142025-06-18T18:46:17.814ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15152025-06-18T18:46:17.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15162025-06-18T18:46:17.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2160 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e01956c2-7fdb-4ffc-954a-0f5395cfcaca response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
15172025-06-18T18:46:17.816ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15182025-06-18T18:46:17.818ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15192025-06-18T18:46:17.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15202025-06-18T18:46:17.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15212025-06-18T18:46:17.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15222025-06-18T18:46:17.821ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15232025-06-18T18:46:17.821ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15242025-06-18T18:46:17.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15252025-06-18T18:46:17.840ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
15262025-06-18T18:46:17.840ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
15272025-06-18T18:46:17.840ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "80275429-f800-43ad-855c-ba02f02b5da3", "date": "Wed, 18 Jun 2025 18:46:17 GMT"} })
15282025-06-18T18:46:17.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15292025-06-18T18:46:17.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15302025-06-18T18:46:17.842ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15312025-06-18T18:46:17.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15322025-06-18T18:46:17.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15332025-06-18T18:46:17.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15342025-06-18T18:46:17.848ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
15352025-06-18T18:46:17.848ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15362025-06-18T18:46:17.848ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4ffabef7-7163-48bb-ac33-26e484828ffe", "date": "Wed, 18 Jun 2025 18:46:17 GMT"} })
15372025-06-18T18:46:17.850ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 293.037772ms iteration = 22 status = {}
15382025-06-18T18:46:17.851ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15392025-06-18T18:46:17.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15402025-06-18T18:46:17.853ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 7e1ff921-047f-464e-8081-f8132af716ac, rack_id: 3a330d2e-6212-46a4-9781-374fdb3dc92f, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(6c07c314-d66b-4041-9040-d774200d26a9) } rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
15412025-06-18T18:46:17.853ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15422025-06-18T18:46:17.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15432025-06-18T18:46:17.865ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
15442025-06-18T18:46:17.865ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 6c07c314-d66b-4041-9040-d774200d26a9
15452025-06-18T18:46:17.865ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
15462025-06-18T18:46:17.865ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
15472025-06-18T18:46:17.865ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15482025-06-18T18:46:17.865ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15492025-06-18T18:46:17.865ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15502025-06-18T18:46:17.865ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15512025-06-18T18:46:17.865ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
15522025-06-18T18:46:17.865ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
15532025-06-18T18:46:17.865ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
15542025-06-18T18:46:17.865ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15552025-06-18T18:46:17.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15562025-06-18T18:46:17.868ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
15572025-06-18T18:46:17.868ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
15582025-06-18T18:46:17.917ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
15592025-06-18T18:46:17.966ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "86893c1d-25cc-4145-8549-05f3c3de8a67", "date": "Wed, 18 Jun 2025 18:46:17 GMT"} })
15602025-06-18T18:46:17.966ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch = Switch0
15612025-06-18T18:46:17.966ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
15622025-06-18T18:46:17.969ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "68a0add6-12ee-4b9c-8cb3-7884e86f44e5", "content-length": "691", "date": "Wed, 18 Jun 2025 18:46:17 GMT"} })
15632025-06-18T18:46:17.969ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
15642025-06-18T18:46:17.969ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
15652025-06-18T18:46:17.969ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
15662025-06-18T18:46:17.969ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa5fafbf-c26d-43f1-813b-19b95bd58414", "content-length": "682", "date": "Wed, 18 Jun 2025 18:46:17 GMT"} })
15672025-06-18T18:46:17.969ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15682025-06-18T18:46:17.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15692025-06-18T18:46:17.970ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 413.089549ms iteration = 22 status = {}
15702025-06-18T18:46:17.974ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15712025-06-18T18:46:17.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15722025-06-18T18:46:17.978ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15732025-06-18T18:46:17.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15742025-06-18T18:46:17.980ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15752025-06-18T18:46:17.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15762025-06-18T18:46:17.988ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 430.345457ms iteration = 22 status = {}
15772025-06-18T18:46:18.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f4b3c6b0-7809-489f-ae6f-6cb3afb6bc00 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
15782025-06-18T18:46:18.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f4b3c6b0-7809-489f-ae6f-6cb3afb6bc00 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
15792025-06-18T18:46:18.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2320 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f4b3c6b0-7809-489f-ae6f-6cb3afb6bc00 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
15802025-06-18T18:46:19.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cdc0d865-7d0f-435b-b064-34ca0e5f02aa roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
15812025-06-18T18:46:19.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cdc0d865-7d0f-435b-b064-34ca0e5f02aa resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
15822025-06-18T18:46:19.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2421 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cdc0d865-7d0f-435b-b064-34ca0e5f02aa response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
15832025-06-18T18:46:20.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = aefa6aa2-074a-4414-9368-5c16fc3c7057 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
15842025-06-18T18:46:20.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = aefa6aa2-074a-4414-9368-5c16fc3c7057 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
15852025-06-18T18:46:20.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2273 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = aefa6aa2-074a-4414-9368-5c16fc3c7057 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
15862025-06-18T18:46:21.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = 9940cef2-49ac-4344-87b9-08b89b39cef6 roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
15872025-06-18T18:46:21.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = 9940cef2-49ac-4344-87b9-08b89b39cef6 resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
15882025-06-18T18:46:21.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2539 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = 9940cef2-49ac-4344-87b9-08b89b39cef6 response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
15892025-06-18T18:46:21.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = 0856e339-eeb1-441a-9596-e53e522cb3e3 roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
15902025-06-18T18:46:21.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = 0856e339-eeb1-441a-9596-e53e522cb3e3 resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
15912025-06-18T18:46:21.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2717 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = 0856e339-eeb1-441a-9596-e53e522cb3e3 response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
15922025-06-18T18:46:21.131ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 509 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = acb70ab0-fa4b-4b26-ae65-0a2a26f3911a response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
15932025-06-18T18:46:21.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 985b773f-ffe7-42d3-8079-b886e0c8969c roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
15942025-06-18T18:46:21.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 985b773f-ffe7-42d3-8079-b886e0c8969c resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
15952025-06-18T18:46:21.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2286 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 985b773f-ffe7-42d3-8079-b886e0c8969c response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
15962025-06-18T18:46:22.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b9a1edc6-27ec-4197-8f91-3c42f92c4933 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
15972025-06-18T18:46:22.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b9a1edc6-27ec-4197-8f91-3c42f92c4933 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
15982025-06-18T18:46:22.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1562 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b9a1edc6-27ec-4197-8f91-3c42f92c4933 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
15992025-06-18T18:46:23.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1a28e219-b7a9-4284-a384-a679e79818ec roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16002025-06-18T18:46:23.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1a28e219-b7a9-4284-a384-a679e79818ec resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16012025-06-18T18:46:23.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2178 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1a28e219-b7a9-4284-a384-a679e79818ec response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16022025-06-18T18:46:24.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 217eb85a-88e5-4105-80ac-8fce3f5df7eb roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16032025-06-18T18:46:24.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 217eb85a-88e5-4105-80ac-8fce3f5df7eb resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16042025-06-18T18:46:24.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3121 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 217eb85a-88e5-4105-80ac-8fce3f5df7eb response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16052025-06-18T18:46:25.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d7ea26e6-639b-4009-b306-4035b1069ea4 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16062025-06-18T18:46:25.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d7ea26e6-639b-4009-b306-4035b1069ea4 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16072025-06-18T18:46:25.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2276 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d7ea26e6-639b-4009-b306-4035b1069ea4 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16082025-06-18T18:46:26.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 37ad14d7-5205-460e-9af7-eeb6f049ec3f roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16092025-06-18T18:46:26.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 37ad14d7-5205-460e-9af7-eeb6f049ec3f resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16102025-06-18T18:46:26.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2281 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 37ad14d7-5205-460e-9af7-eeb6f049ec3f response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16112025-06-18T18:46:27.557ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
16122025-06-18T18:46:27.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
16132025-06-18T18:46:27.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16142025-06-18T18:46:27.557ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16152025-06-18T18:46:27.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16162025-06-18T18:46:27.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16172025-06-18T18:46:27.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16182025-06-18T18:46:27.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16192025-06-18T18:46:27.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16202025-06-18T18:46:27.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16212025-06-18T18:46:27.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16222025-06-18T18:46:27.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16232025-06-18T18:46:27.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16242025-06-18T18:46:27.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
16252025-06-18T18:46:27.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16262025-06-18T18:46:27.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16272025-06-18T18:46:27.583ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
16282025-06-18T18:46:27.583ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.480552ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
16292025-06-18T18:46:27.590ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16302025-06-18T18:46:27.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16312025-06-18T18:46:27.632ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.043665ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16322025-06-18T18:46:27.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5be731a9-a105-4f93-90a5-208fc043eb7d roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16332025-06-18T18:46:27.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5be731a9-a105-4f93-90a5-208fc043eb7d resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16342025-06-18T18:46:27.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2251 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5be731a9-a105-4f93-90a5-208fc043eb7d response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16352025-06-18T18:46:28.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bef6aee3-55b2-4903-bf4f-55824cab47aa roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16362025-06-18T18:46:28.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bef6aee3-55b2-4903-bf4f-55824cab47aa resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16372025-06-18T18:46:28.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2343 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bef6aee3-55b2-4903-bf4f-55824cab47aa response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16382025-06-18T18:46:30.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3dd5321c-0eef-44f6-b8c4-19bdbe8e1cdc roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16392025-06-18T18:46:30.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3dd5321c-0eef-44f6-b8c4-19bdbe8e1cdc resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16402025-06-18T18:46:30.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2934 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3dd5321c-0eef-44f6-b8c4-19bdbe8e1cdc response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16412025-06-18T18:46:31.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = fc96d09f-82c2-4254-be30-acedf622b4d0 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16422025-06-18T18:46:31.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = fc96d09f-82c2-4254-be30-acedf622b4d0 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16432025-06-18T18:46:31.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2341 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = fc96d09f-82c2-4254-be30-acedf622b4d0 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16442025-06-18T18:46:31.132ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 547 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 1894f855-546a-4538-85ae-db3410773e01 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
16452025-06-18T18:46:32.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e4603f93-9565-4f3e-9a3d-8bfd8e4d78f2 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16462025-06-18T18:46:32.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e4603f93-9565-4f3e-9a3d-8bfd8e4d78f2 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16472025-06-18T18:46:32.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2450 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e4603f93-9565-4f3e-9a3d-8bfd8e4d78f2 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16482025-06-18T18:46:33.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f03ecf6e-e52a-4219-97c1-44eb4ea9a830 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16492025-06-18T18:46:33.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f03ecf6e-e52a-4219-97c1-44eb4ea9a830 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16502025-06-18T18:46:33.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2188 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f03ecf6e-e52a-4219-97c1-44eb4ea9a830 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16512025-06-18T18:46:34.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1a5c19c4-af2b-4814-beef-8dad8ce5f39b roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16522025-06-18T18:46:34.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1a5c19c4-af2b-4814-beef-8dad8ce5f39b resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16532025-06-18T18:46:34.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2124 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1a5c19c4-af2b-4814-beef-8dad8ce5f39b response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16542025-06-18T18:46:35.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 401f0ac1-0a76-4a8b-848b-f5b269f8c2b1 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16552025-06-18T18:46:35.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 401f0ac1-0a76-4a8b-848b-f5b269f8c2b1 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16562025-06-18T18:46:35.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1795 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 401f0ac1-0a76-4a8b-848b-f5b269f8c2b1 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16572025-06-18T18:46:36.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 83d1ae0b-ef4e-45be-a83b-90ff0905ab55 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16582025-06-18T18:46:36.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 83d1ae0b-ef4e-45be-a83b-90ff0905ab55 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16592025-06-18T18:46:36.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2684 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 83d1ae0b-ef4e-45be-a83b-90ff0905ab55 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16602025-06-18T18:46:36.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = 803bead4-75c5-4248-b53d-ae1eabb010ec roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
16612025-06-18T18:46:36.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = 803bead4-75c5-4248-b53d-ae1eabb010ec resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
16622025-06-18T18:46:36.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3053 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = 803bead4-75c5-4248-b53d-ae1eabb010ec response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
16632025-06-18T18:46:36.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = c2bf3ca3-f48e-4727-b317-a2b05899c123 roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
16642025-06-18T18:46:36.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = c2bf3ca3-f48e-4727-b317-a2b05899c123 resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
16652025-06-18T18:46:36.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2520 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37917 req_id = c2bf3ca3-f48e-4727-b317-a2b05899c123 response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
16662025-06-18T18:46:37.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c3cc808a-9873-47a5-9c7b-737371fa8cd6 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16672025-06-18T18:46:37.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c3cc808a-9873-47a5-9c7b-737371fa8cd6 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16682025-06-18T18:46:37.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2160 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c3cc808a-9873-47a5-9c7b-737371fa8cd6 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16692025-06-18T18:46:37.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
16702025-06-18T18:46:37.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16712025-06-18T18:46:37.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
16722025-06-18T18:46:37.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16732025-06-18T18:46:37.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16742025-06-18T18:46:37.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16752025-06-18T18:46:37.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16762025-06-18T18:46:37.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16772025-06-18T18:46:37.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16782025-06-18T18:46:37.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16792025-06-18T18:46:37.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16802025-06-18T18:46:37.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16812025-06-18T18:46:37.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16822025-06-18T18:46:37.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
16832025-06-18T18:46:37.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16842025-06-18T18:46:37.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16852025-06-18T18:46:37.582ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
16862025-06-18T18:46:37.582ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.897904ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
16872025-06-18T18:46:37.592ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16882025-06-18T18:46:37.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16892025-06-18T18:46:37.625ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.156256ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16902025-06-18T18:46:38.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d0e8e19c-0a81-452f-bfb7-2fd68c337eab roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16912025-06-18T18:46:38.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d0e8e19c-0a81-452f-bfb7-2fd68c337eab resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16922025-06-18T18:46:38.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2146 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d0e8e19c-0a81-452f-bfb7-2fd68c337eab response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16932025-06-18T18:46:39.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a42344b5-6454-483b-9fa8-435d6fa83e68 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16942025-06-18T18:46:39.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a42344b5-6454-483b-9fa8-435d6fa83e68 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16952025-06-18T18:46:39.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1512 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a42344b5-6454-483b-9fa8-435d6fa83e68 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16962025-06-18T18:46:40.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3a58518e-c28d-4c2b-9eac-c1ff1b86314f roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16972025-06-18T18:46:40.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3a58518e-c28d-4c2b-9eac-c1ff1b86314f resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16982025-06-18T18:46:40.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2558 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3a58518e-c28d-4c2b-9eac-c1ff1b86314f response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
16992025-06-18T18:46:41.132ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 916 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = b32563e1-b4fe-4598-8e79-5bca92797782 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
17002025-06-18T18:46:41.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3d9c3de6-89b5-4f72-819a-a5e009dc6a5b roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
17012025-06-18T18:46:41.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3d9c3de6-89b5-4f72-819a-a5e009dc6a5b resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
17022025-06-18T18:46:41.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2370 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3d9c3de6-89b5-4f72-819a-a5e009dc6a5b response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
17032025-06-18T18:46:42.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4ab81091-0e2b-4dc3-ad7c-5d1360cddf1b roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
17042025-06-18T18:46:42.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4ab81091-0e2b-4dc3-ad7c-5d1360cddf1b resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
17052025-06-18T18:46:42.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2398 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4ab81091-0e2b-4dc3-ad7c-5d1360cddf1b response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
17062025-06-18T18:46:43.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 752a14ac-62cb-4813-bce0-ccdd879baaa7 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
17072025-06-18T18:46:43.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 752a14ac-62cb-4813-bce0-ccdd879baaa7 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
17082025-06-18T18:46:43.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1928 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 752a14ac-62cb-4813-bce0-ccdd879baaa7 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
17092025-06-18T18:46:44.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 004eb5ea-ed13-4530-8b60-84621c6cb3d7 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
17102025-06-18T18:46:44.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 004eb5ea-ed13-4530-8b60-84621c6cb3d7 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
17112025-06-18T18:46:44.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2092 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 004eb5ea-ed13-4530-8b60-84621c6cb3d7 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
17122025-06-18T18:46:45.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c6a5f08d-b22d-4bc8-becb-b982a422b388 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
17132025-06-18T18:46:45.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c6a5f08d-b22d-4bc8-becb-b982a422b388 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
17142025-06-18T18:46:45.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2417 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c6a5f08d-b22d-4bc8-becb-b982a422b388 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
17152025-06-18T18:46:46.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6f8bd48d-1fa4-415f-8ddd-5ca566076398 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
17162025-06-18T18:46:46.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6f8bd48d-1fa4-415f-8ddd-5ca566076398 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
17172025-06-18T18:46:46.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2541 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6f8bd48d-1fa4-415f-8ddd-5ca566076398 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
17182025-06-18T18:46:47.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d8d8fabc-a508-4eb7-b45e-bf6a563f60c8 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
17192025-06-18T18:46:47.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d8d8fabc-a508-4eb7-b45e-bf6a563f60c8 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
17202025-06-18T18:46:47.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1778 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d8d8fabc-a508-4eb7-b45e-bf6a563f60c8 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
17212025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
17222025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17232025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
17242025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
17252025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 12 reason = Timeout
17262025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
17272025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
17282025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 12 reason = Timeout
17292025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
17302025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
17312025-06-18T18:46:47.557ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-18 18:36:47.557761778 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
17322025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
17332025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
17342025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
17352025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
17362025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
17372025-06-18T18:46:47.557ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
17382025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
17392025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
17402025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17412025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
17422025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
17432025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17442025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
17452025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
17462025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
17472025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17482025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
17492025-06-18T18:46:47.557ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
17502025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
17512025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
17522025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
17532025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
17542025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17552025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
17562025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17572025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
17582025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
17592025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
17602025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
17612025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17622025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Timeout
17632025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17642025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
17652025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
17662025-06-18T18:46:47.558ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe
17672025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
17682025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.98\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe"}
17692025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
17702025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17712025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
17722025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
17732025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17742025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 23 reason = Timeout
17752025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
17762025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
17772025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
17782025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
17792025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
17802025-06-18T18:46:47.558ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
17812025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17822025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
17832025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17842025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
17852025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17862025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
17872025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
17882025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17892025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
17902025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17912025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
17922025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17932025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
17942025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
17952025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
17962025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
17972025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17982025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
17992025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
18002025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18012025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18022025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18032025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18042025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18052025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
18062025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18072025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
18082025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18092025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18102025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18112025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18122025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18132025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
18142025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18152025-06-18T18:46:47.558ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("51411444-5ad0-46e8-b345-7ee26fb32a60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("adea75c9-2ff2-4f9f-bfac-48c7702333e0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea7c6eed-68db-4cd0-929a-17b08777d263.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea7c6eed-68db-4cd0-929a-17b08777d263.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1597, tv_nsec: 139847564 } })
18162025-06-18T18:46:47.558ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("03fce462-e4e1-4a86-890b-8a2ae9e17168.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("800703b5-0601-4ce2-acc3-d5b9ca473160.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("800703b5-0601-4ce2-acc3-d5b9ca473160.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1597, tv_nsec: 139856114 } })
18172025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18182025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
18192025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18202025-06-18T18:46:47.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18212025-06-18T18:46:47.559ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
18222025-06-18T18:46:47.559ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.270997ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
18232025-06-18T18:46:47.559ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
18242025-06-18T18:46:47.559ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.40725ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
18252025-06-18T18:46:47.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18262025-06-18T18:46:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18272025-06-18T18:46:47.561ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.795443ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
18282025-06-18T18:46:47.561ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.809123ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
18292025-06-18T18:46:47.562ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18302025-06-18T18:46:47.562ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
18312025-06-18T18:46:47.562ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 4.572203ms iteration = 12 status = {"by_rx":{},"error":null}
18322025-06-18T18:46:47.562ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.970199ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
18332025-06-18T18:46:47.563ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-18 18:36:47.557761778 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
18342025-06-18T18:46:47.563ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.890271ms iteration = 12 status = {"expiration":"2025-06-18T18:36:47.557761778Z","pruned":[]}
18352025-06-18T18:46:47.564ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18362025-06-18T18:46:47.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
18372025-06-18T18:46:47.564ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
18382025-06-18T18:46:47.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
18392025-06-18T18:46:47.565ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18402025-06-18T18:46:47.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18412025-06-18T18:46:47.566ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18422025-06-18T18:46:47.566ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
18432025-06-18T18:46:47.566ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18442025-06-18T18:46:47.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18452025-06-18T18:46:47.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18462025-06-18T18:46:47.566ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18472025-06-18T18:46:47.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
18482025-06-18T18:46:47.568ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18492025-06-18T18:46:47.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18502025-06-18T18:46:47.570ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18512025-06-18T18:46:47.571ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1597, tv_nsec: 152178614 } })
18522025-06-18T18:46:47.571ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
18532025-06-18T18:46:47.572ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18542025-06-18T18:46:47.572ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18552025-06-18T18:46:47.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18562025-06-18T18:46:47.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18572025-06-18T18:46:47.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18582025-06-18T18:46:47.575ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18592025-06-18T18:46:47.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18602025-06-18T18:46:47.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18612025-06-18T18:46:47.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
18622025-06-18T18:46:47.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18632025-06-18T18:46:47.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18642025-06-18T18:46:47.577ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18652025-06-18T18:46:47.579ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1597, tv_nsec: 160905984 } })
18662025-06-18T18:46:47.580ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
18672025-06-18T18:46:47.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18682025-06-18T18:46:47.581ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18692025-06-18T18:46:47.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18702025-06-18T18:46:47.584ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
18712025-06-18T18:46:47.584ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18722025-06-18T18:46:47.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
18732025-06-18T18:46:47.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18742025-06-18T18:46:47.587ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18752025-06-18T18:46:47.587ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18762025-06-18T18:46:47.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18772025-06-18T18:46:47.588ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
18782025-06-18T18:46:47.588ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 30.866116ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
18792025-06-18T18:46:47.591ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18802025-06-18T18:46:47.591ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18812025-06-18T18:46:47.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18822025-06-18T18:46:47.592ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18832025-06-18T18:46:47.593ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18842025-06-18T18:46:47.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18852025-06-18T18:46:47.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18862025-06-18T18:46:47.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18872025-06-18T18:46:47.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18882025-06-18T18:46:47.594ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18892025-06-18T18:46:47.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18902025-06-18T18:46:47.597ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 39.758338ms iteration = 12 status = {"dispatched":[],"errors":[],"glob_version":"150.0.0","globs_reprocessed":{},"no_receivers":[]}
18912025-06-18T18:46:47.598ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
18922025-06-18T18:46:47.598ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
18932025-06-18T18:46:47.598ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 40.60527ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
18942025-06-18T18:46:47.598ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18952025-06-18T18:46:47.598ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
18962025-06-18T18:46:47.598ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18972025-06-18T18:46:47.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18982025-06-18T18:46:47.601ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18992025-06-18T18:46:47.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19002025-06-18T18:46:47.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19012025-06-18T18:46:47.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
19022025-06-18T18:46:47.606ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19032025-06-18T18:46:47.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19042025-06-18T18:46:47.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.840064ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
19052025-06-18T18:46:47.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19062025-06-18T18:46:47.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19072025-06-18T18:46:47.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19082025-06-18T18:46:47.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19092025-06-18T18:46:47.622ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 64.226596ms iteration = 23 status = {"errors":[],"requests_created_ok":[]}
19102025-06-18T18:46:47.624ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19112025-06-18T18:46:47.624ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19122025-06-18T18:46:47.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19132025-06-18T18:46:47.625ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.590993ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19142025-06-18T18:46:47.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
19152025-06-18T18:46:47.626ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
19162025-06-18T18:46:47.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
19172025-06-18T18:46:47.630ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19182025-06-18T18:46:47.633ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
19192025-06-18T18:46:47.633ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
19202025-06-18T18:46:47.633ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 75.223548ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
19212025-06-18T18:46:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19222025-06-18T18:46:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19232025-06-18T18:46:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19242025-06-18T18:46:47.635ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19252025-06-18T18:46:47.638ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19262025-06-18T18:46:47.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19272025-06-18T18:46:47.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19282025-06-18T18:46:47.674ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
19292025-06-18T18:46:47.674ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
19302025-06-18T18:46:47.674ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
19312025-06-18T18:46:47.674ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19322025-06-18T18:46:47.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19332025-06-18T18:46:47.676ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
19342025-06-18T18:46:47.678ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
19352025-06-18T18:46:47.678ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
19362025-06-18T18:46:47.678ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
19372025-06-18T18:46:47.678ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19382025-06-18T18:46:47.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19392025-06-18T18:46:47.682ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
19402025-06-18T18:46:47.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
19412025-06-18T18:46:47.699ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19422025-06-18T18:46:47.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19432025-06-18T18:46:47.703ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
19442025-06-18T18:46:47.703ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19452025-06-18T18:46:47.704ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3369a165-d774-4238-8341-4d233d8f6df7", "content-length": "26", "date": "Wed, 18 Jun 2025 18:46:47 GMT"} })
19462025-06-18T18:46:47.704ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19472025-06-18T18:46:47.706ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19482025-06-18T18:46:47.750ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
19492025-06-18T18:46:47.750ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19502025-06-18T18:46:47.751ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d32fad7-a2ea-4c80-b27b-dc810dfb1bf1", "content-length": "372", "date": "Wed, 18 Jun 2025 18:46:47 GMT"} })
19512025-06-18T18:46:47.751ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19522025-06-18T18:46:47.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19532025-06-18T18:46:47.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19542025-06-18T18:46:47.756ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1597, tv_nsec: 337341468 } })
19552025-06-18T18:46:47.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
19562025-06-18T18:46:47.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19572025-06-18T18:46:47.756ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
19582025-06-18T18:46:47.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19592025-06-18T18:46:47.757ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19602025-06-18T18:46:47.757ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19612025-06-18T18:46:47.757ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19622025-06-18T18:46:47.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19632025-06-18T18:46:47.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19642025-06-18T18:46:47.762ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19652025-06-18T18:46:47.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19662025-06-18T18:46:47.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19672025-06-18T18:46:47.763ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19682025-06-18T18:46:47.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19692025-06-18T18:46:47.765ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19702025-06-18T18:46:47.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9fbbc826-5b83-4b80-8172-66302c618aae, lookup_type: ById(9fbbc826-5b83-4b80-8172-66302c618aae) } result = Ok(())
19712025-06-18T18:46:47.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19722025-06-18T18:46:47.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19732025-06-18T18:46:47.771ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
19742025-06-18T18:46:47.774ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 216.073341ms iteration = 23 status = 0
19752025-06-18T18:46:47.791ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
19762025-06-18T18:46:47.791ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 233.020195ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
19772025-06-18T18:46:47.799ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 241.38794ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19782025-06-18T18:46:47.802ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19792025-06-18T18:46:47.803ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19802025-06-18T18:46:47.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19812025-06-18T18:46:47.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19822025-06-18T18:46:47.804ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19832025-06-18T18:46:47.804ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
19842025-06-18T18:46:47.804ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19852025-06-18T18:46:47.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19862025-06-18T18:46:47.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 248.028222ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19872025-06-18T18:46:47.806ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
19882025-06-18T18:46:47.806ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 72dd4529-6655-4d30-a1d8-0de429d0133c dns_zone_name = oxide.test found_so_far = 0 version = 2
19892025-06-18T18:46:47.806ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19902025-06-18T18:46:47.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19912025-06-18T18:46:47.808ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
19922025-06-18T18:46:47.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
19932025-06-18T18:46:47.810ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19942025-06-18T18:46:47.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
19952025-06-18T18:46:47.812ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
19962025-06-18T18:46:47.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
19972025-06-18T18:46:47.814ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
19982025-06-18T18:46:47.814ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 256.506249ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
19992025-06-18T18:46:47.817ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
20002025-06-18T18:46:47.817ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = ab8dd933-5e45-404d-97a3-fdafa1c7d91b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
20012025-06-18T18:46:47.817ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20022025-06-18T18:46:47.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20032025-06-18T18:46:47.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20042025-06-18T18:46:47.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20052025-06-18T18:46:47.819ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20062025-06-18T18:46:47.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20072025-06-18T18:46:47.822ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20082025-06-18T18:46:47.822ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20092025-06-18T18:46:47.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20102025-06-18T18:46:47.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20112025-06-18T18:46:47.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20122025-06-18T18:46:47.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20132025-06-18T18:46:47.827ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
20142025-06-18T18:46:47.827ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20152025-06-18T18:46:47.827ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "965182c2-5117-434b-beb7-0513818afa5d", "date": "Wed, 18 Jun 2025 18:46:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
20162025-06-18T18:46:47.827ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
20172025-06-18T18:46:47.829ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f64f9821-6781-405a-9973-4a75a36e5a60", "date": "Wed, 18 Jun 2025 18:46:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
20182025-06-18T18:46:47.829ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
20192025-06-18T18:46:47.829ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = ab8dd933-5e45-404d-97a3-fdafa1c7d91b dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
20202025-06-18T18:46:47.829ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
20212025-06-18T18:46:47.829ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-18 18:36:19.303122 UTC dns_group = internal generation = 1
20222025-06-18T18:46:47.829ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 271.925601ms iteration = 12 status = {"generation":1}
20232025-06-18T18:46:47.831ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
20242025-06-18T18:46:47.831ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 273.349682ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
20252025-06-18T18:46:47.831ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20262025-06-18T18:46:47.831ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20272025-06-18T18:46:47.831ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
20282025-06-18T18:46:47.831ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
20292025-06-18T18:46:47.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20302025-06-18T18:46:47.831ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fe9e399d-401d-48a2-befe-7f223d2d1693", "date": "Wed, 18 Jun 2025 18:46:47 GMT"} })
20312025-06-18T18:46:47.831ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20322025-06-18T18:46:47.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20332025-06-18T18:46:47.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20342025-06-18T18:46:47.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20352025-06-18T18:46:47.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20362025-06-18T18:46:47.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20372025-06-18T18:46:47.843ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
20382025-06-18T18:46:47.843ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20392025-06-18T18:46:47.843ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5498f18e-f6c6-49a5-b72f-3d5cf31c4989", "date": "Wed, 18 Jun 2025 18:46:47 GMT"} })
20402025-06-18T18:46:47.845ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 287.261553ms iteration = 23 status = {}
20412025-06-18T18:46:47.848ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20422025-06-18T18:46:47.848ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
20432025-06-18T18:46:47.848ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 290.391246ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
20442025-06-18T18:46:47.850ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20452025-06-18T18:46:47.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 292.80249ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
20462025-06-18T18:46:47.850ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 292.78883ms iteration = 23 status = {}
20472025-06-18T18:46:47.852ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
20482025-06-18T18:46:47.852ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20492025-06-18T18:46:47.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20502025-06-18T18:46:47.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20512025-06-18T18:46:47.855ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
20522025-06-18T18:46:47.855ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20532025-06-18T18:46:47.856ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "396616b6-a032-439c-a30e-b71dccab4770", "content-length": "26", "date": "Wed, 18 Jun 2025 18:46:47 GMT"} })
20542025-06-18T18:46:47.856ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20552025-06-18T18:46:47.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20562025-06-18T18:46:47.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20572025-06-18T18:46:47.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20582025-06-18T18:46:47.858ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
20592025-06-18T18:46:47.859ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 72dd4529-6655-4d30-a1d8-0de429d0133c dns_zone_name = oxide.test found_so_far = 4 version = 2
20602025-06-18T18:46:47.859ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
20612025-06-18T18:46:47.859ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-18 18:36:20.010620 UTC dns_group = external generation = 2
20622025-06-18T18:46:47.859ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 301.218636ms iteration = 12 status = {"generation":2}
20632025-06-18T18:46:47.880ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f zone_address = fd00:1122:3344:101::2
20642025-06-18T18:46:47.880ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20652025-06-18T18:46:47.880ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f9692fc-5e20-4b48-b635-184bd50b14fd", "content-length": "26", "date": "Wed, 18 Jun 2025 18:46:47 GMT"} })
20662025-06-18T18:46:47.880ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20672025-06-18T18:46:47.881ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
20682025-06-18T18:46:47.884ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 326.476564ms iteration = 26 status = {"physical_disks_added":0}
20692025-06-18T18:46:47.894ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-18T18:35:46.206089Z, time_modified: 2025-06-18T18:35:46.206089Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 472c0288-095b-456c-b18f-d5f22a8efd72, db_silo: Silo { identity: SiloIdentity { id: 472c0288-095b-456c-b18f-d5f22a8efd72, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-18T18:36:19.955323Z, time_modified: 2025-06-18T18:36:19.955323Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 472c0288-095b-456c-b18f-d5f22a8efd72, db_silo: Silo { identity: SiloIdentity { id: 472c0288-095b-456c-b18f-d5f22a8efd72, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-18T18:36:19.955323Z, time_modified: 2025-06-18T18:36:19.955323Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3" }] }) }
20702025-06-18T18:46:47.894ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 336.863038ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"472c0288-095b-456c-b18f-d5f22a8efd72","tls_certs":["6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3"]}},"default_endpoint":{"silo_id":"472c0288-095b-456c-b18f-d5f22a8efd72","tls_certs":["6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
20712025-06-18T18:46:47.910ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
20722025-06-18T18:46:47.923ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
20732025-06-18T18:46:47.923ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 365.292959ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
20742025-06-18T18:46:47.946ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20752025-06-18T18:46:47.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20762025-06-18T18:46:47.948ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 390.767201ms iteration = 23 status = null
20772025-06-18T18:46:47.991ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
20782025-06-18T18:46:47.991ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d17872f-cbf5-46a7-b6af-6e593f43dbb9", "content-length": "691", "date": "Wed, 18 Jun 2025 18:46:47 GMT"} })
20792025-06-18T18:46:47.991ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
20802025-06-18T18:46:47.991ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
20812025-06-18T18:46:47.991ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
20822025-06-18T18:46:47.992ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 434.434973ms iteration = 23 status = {}
20832025-06-18T18:46:47.993ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
20842025-06-18T18:46:47.993ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "888c5cb1-3fff-4315-b68f-b8624b19380d", "date": "Wed, 18 Jun 2025 18:46:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
20852025-06-18T18:46:47.993ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
20862025-06-18T18:46:47.995ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d04210cd-192d-4cf2-a97b-c2c0bed0e3da", "date": "Wed, 18 Jun 2025 18:46:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
20872025-06-18T18:46:47.995ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
20882025-06-18T18:46:47.997ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "0171055e-9936-4a12-914d-222b51916cfd", "date": "Wed, 18 Jun 2025 18:46:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
20892025-06-18T18:46:47.997ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
20902025-06-18T18:46:47.999ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
20912025-06-18T18:46:47.999ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 441.841696ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
20922025-06-18T18:46:48.042ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20932025-06-18T18:46:48.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20942025-06-18T18:46:48.044ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 7e1ff921-047f-464e-8081-f8132af716ac, rack_id: 3a330d2e-6212-46a4-9781-374fdb3dc92f, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(6c07c314-d66b-4041-9040-d774200d26a9) } rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
20952025-06-18T18:46:48.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20962025-06-18T18:46:48.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20972025-06-18T18:46:48.056ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
20982025-06-18T18:46:48.056ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 6c07c314-d66b-4041-9040-d774200d26a9
20992025-06-18T18:46:48.056ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
21002025-06-18T18:46:48.056ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
21012025-06-18T18:46:48.056ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21022025-06-18T18:46:48.056ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21032025-06-18T18:46:48.056ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21042025-06-18T18:46:48.056ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21052025-06-18T18:46:48.057ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21062025-06-18T18:46:48.057ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21072025-06-18T18:46:48.057ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
21082025-06-18T18:46:48.057ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21092025-06-18T18:46:48.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21102025-06-18T18:46:48.059ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
21112025-06-18T18:46:48.059ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
21122025-06-18T18:46:48.165ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "48222a54-672c-48e2-8ee2-17243b41ac1b", "date": "Wed, 18 Jun 2025 18:46:47 GMT"} })
21132025-06-18T18:46:48.165ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch = Switch0
21142025-06-18T18:46:48.165ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
21152025-06-18T18:46:48.166ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e9be999-a5ea-4304-9749-1b117414d93f", "content-length": "682", "date": "Wed, 18 Jun 2025 18:46:47 GMT"} })
21162025-06-18T18:46:48.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21172025-06-18T18:46:48.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21182025-06-18T18:46:48.169ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21192025-06-18T18:46:48.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21202025-06-18T18:46:48.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21212025-06-18T18:46:48.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21222025-06-18T18:46:48.175ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21232025-06-18T18:46:48.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21242025-06-18T18:46:48.182ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 624.498505ms iteration = 23 status = {}
21252025-06-18T18:46:48.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 95fa402d-cf9a-411c-8eff-25466a230f42 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21262025-06-18T18:46:48.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 95fa402d-cf9a-411c-8eff-25466a230f42 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21272025-06-18T18:46:48.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2590 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 95fa402d-cf9a-411c-8eff-25466a230f42 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21282025-06-18T18:46:48.555ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 4
21292025-06-18T18:46:48.555ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221
21302025-06-18T18:46:48.592ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
21312025-06-18T18:46:48.592ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:45523
21322025-06-18T18:46:48.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:45523 req_id = 42de5863-4159-4ae7-b285-b2787ff1b5e5 roles = RoleSet { roles: {} } uri = /metrics/producers
21332025-06-18T18:46:48.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:45523 req_id = 42de5863-4159-4ae7-b285-b2787ff1b5e5 resource = Database result = Ok(()) uri = /metrics/producers
21342025-06-18T18:46:48.661ZINFOnexus: assigned collector to new producer collector_id = c88bda47-97a6-468e-bf39-3fffe994d639 file = nexus/src/app/oximeter.rs:76 producer_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
21352025-06-18T18:46:48.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 68081 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:45523 req_id = 42de5863-4159-4ae7-b285-b2787ff1b5e5 response_code = 201 uri = /metrics/producers
21362025-06-18T18:46:48.661ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "42de5863-4159-4ae7-b285-b2787ff1b5e5", "content-length": "41", "date": "Wed, 18 Jun 2025 18:46:48 GMT"} })
21372025-06-18T18:46:48.662ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
21382025-06-18T18:46:49.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a0b363b7-2c73-4f61-a64d-d9ea53af780b roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21392025-06-18T18:46:49.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a0b363b7-2c73-4f61-a64d-d9ea53af780b resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21402025-06-18T18:46:49.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2242 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a0b363b7-2c73-4f61-a64d-d9ea53af780b response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21412025-06-18T18:46:50.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d3205f02-a082-4ffd-a99e-dcc054e64010 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21422025-06-18T18:46:50.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d3205f02-a082-4ffd-a99e-dcc054e64010 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21432025-06-18T18:46:50.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2845 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d3205f02-a082-4ffd-a99e-dcc054e64010 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21442025-06-18T18:46:51.132ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 584 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 26edf069-3929-4a53-a6db-1ba5ead01a62 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
21452025-06-18T18:46:51.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8cd84651-acbb-452c-a96a-d12110b95e5b roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21462025-06-18T18:46:51.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8cd84651-acbb-452c-a96a-d12110b95e5b resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21472025-06-18T18:46:51.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2784 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8cd84651-acbb-452c-a96a-d12110b95e5b response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21482025-06-18T18:46:52.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 60c0b357-3a39-4ce3-9727-1117da8da782 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21492025-06-18T18:46:52.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 60c0b357-3a39-4ce3-9727-1117da8da782 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21502025-06-18T18:46:52.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2537 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 60c0b357-3a39-4ce3-9727-1117da8da782 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21512025-06-18T18:46:53.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 897aba93-5766-4e4f-8316-9f4855e28b24 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21522025-06-18T18:46:53.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 897aba93-5766-4e4f-8316-9f4855e28b24 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21532025-06-18T18:46:53.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2239 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 897aba93-5766-4e4f-8316-9f4855e28b24 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21542025-06-18T18:46:54.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1989fe5a-64b5-4b04-a2d3-73c278a0507a roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21552025-06-18T18:46:54.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1989fe5a-64b5-4b04-a2d3-73c278a0507a resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21562025-06-18T18:46:54.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2632 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1989fe5a-64b5-4b04-a2d3-73c278a0507a response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21572025-06-18T18:46:55.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b6bc29fb-79f0-4593-a7a8-62194d2a0fd5 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21582025-06-18T18:46:55.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b6bc29fb-79f0-4593-a7a8-62194d2a0fd5 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21592025-06-18T18:46:55.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2421 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b6bc29fb-79f0-4593-a7a8-62194d2a0fd5 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21602025-06-18T18:46:56.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ff87fe47-cdf3-491c-b3ea-dbb64f29b63e roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21612025-06-18T18:46:56.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ff87fe47-cdf3-491c-b3ea-dbb64f29b63e resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21622025-06-18T18:46:56.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2264 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ff87fe47-cdf3-491c-b3ea-dbb64f29b63e response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21632025-06-18T18:46:57.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3e15bc78-d00d-4ada-9760-55565e14287d roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21642025-06-18T18:46:57.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3e15bc78-d00d-4ada-9760-55565e14287d resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21652025-06-18T18:46:57.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2238 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3e15bc78-d00d-4ada-9760-55565e14287d response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21662025-06-18T18:46:57.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
21672025-06-18T18:46:57.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21682025-06-18T18:46:57.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
21692025-06-18T18:46:57.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21702025-06-18T18:46:57.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21712025-06-18T18:46:57.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21722025-06-18T18:46:57.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21732025-06-18T18:46:57.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21742025-06-18T18:46:57.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21752025-06-18T18:46:57.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21762025-06-18T18:46:57.595ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21772025-06-18T18:46:57.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21782025-06-18T18:46:57.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21792025-06-18T18:46:57.597ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.696198ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21802025-06-18T18:46:57.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21812025-06-18T18:46:57.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21822025-06-18T18:46:57.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
21832025-06-18T18:46:57.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21842025-06-18T18:46:57.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21852025-06-18T18:46:57.614ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
21862025-06-18T18:46:57.614ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.597001ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
21872025-06-18T18:46:58.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ab41e5d2-196a-430b-9673-45fd24225758 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21882025-06-18T18:46:58.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ab41e5d2-196a-430b-9673-45fd24225758 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21892025-06-18T18:46:58.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2278 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ab41e5d2-196a-430b-9673-45fd24225758 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21902025-06-18T18:46:59.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f680a253-f310-4010-959a-56b5ca95b8f1 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21912025-06-18T18:46:59.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f680a253-f310-4010-959a-56b5ca95b8f1 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21922025-06-18T18:46:59.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2634 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f680a253-f310-4010-959a-56b5ca95b8f1 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21932025-06-18T18:47:00.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b37a5401-dcf2-43df-96ca-02052fcf970c roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21942025-06-18T18:47:00.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b37a5401-dcf2-43df-96ca-02052fcf970c resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21952025-06-18T18:47:00.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2829 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b37a5401-dcf2-43df-96ca-02052fcf970c response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21962025-06-18T18:47:01.133ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 923 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = a0cad3f4-8f09-4c5e-83f5-62deb39c64e8 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
21972025-06-18T18:47:01.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 651e8690-7764-4d4e-987b-ce7f39a64b0a roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21982025-06-18T18:47:01.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 651e8690-7764-4d4e-987b-ce7f39a64b0a resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
21992025-06-18T18:47:01.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1794 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 651e8690-7764-4d4e-987b-ce7f39a64b0a response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22002025-06-18T18:47:02.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7960b0ac-2f89-4c66-92fb-a0ba0ffece84 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22012025-06-18T18:47:02.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7960b0ac-2f89-4c66-92fb-a0ba0ffece84 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22022025-06-18T18:47:02.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1842 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7960b0ac-2f89-4c66-92fb-a0ba0ffece84 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22032025-06-18T18:47:03.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 89d26674-9633-4d29-b846-b922569fe2d3 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22042025-06-18T18:47:03.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 89d26674-9633-4d29-b846-b922569fe2d3 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22052025-06-18T18:47:03.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2255 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 89d26674-9633-4d29-b846-b922569fe2d3 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22062025-06-18T18:47:04.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 98024461-fa71-4125-a59f-1e9f87e856e7 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22072025-06-18T18:47:04.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 98024461-fa71-4125-a59f-1e9f87e856e7 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22082025-06-18T18:47:04.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2181 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 98024461-fa71-4125-a59f-1e9f87e856e7 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22092025-06-18T18:47:05.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6520eb93-411d-41e8-9962-7746ceb46b07 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22102025-06-18T18:47:05.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6520eb93-411d-41e8-9962-7746ceb46b07 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22112025-06-18T18:47:05.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1743 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6520eb93-411d-41e8-9962-7746ceb46b07 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22122025-06-18T18:47:06.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7c6cb24b-644f-4ccf-b4e4-e59221ef15b7 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22132025-06-18T18:47:06.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7c6cb24b-644f-4ccf-b4e4-e59221ef15b7 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22142025-06-18T18:47:06.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2068 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7c6cb24b-644f-4ccf-b4e4-e59221ef15b7 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22152025-06-18T18:47:07.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
22162025-06-18T18:47:07.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
22172025-06-18T18:47:07.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22182025-06-18T18:47:07.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22192025-06-18T18:47:07.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22202025-06-18T18:47:07.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22212025-06-18T18:47:07.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22222025-06-18T18:47:07.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22232025-06-18T18:47:07.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22242025-06-18T18:47:07.563ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.500812ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22252025-06-18T18:47:07.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22262025-06-18T18:47:07.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22272025-06-18T18:47:07.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22282025-06-18T18:47:07.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22292025-06-18T18:47:07.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22302025-06-18T18:47:07.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22312025-06-18T18:47:07.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
22322025-06-18T18:47:07.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22332025-06-18T18:47:07.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22342025-06-18T18:47:07.580ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
22352025-06-18T18:47:07.580ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.794771ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
22362025-06-18T18:47:07.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 2e10b3c2-4482-4758-8d6d-d76e60847c25 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22372025-06-18T18:47:07.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 2e10b3c2-4482-4758-8d6d-d76e60847c25 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22382025-06-18T18:47:07.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1583 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 2e10b3c2-4482-4758-8d6d-d76e60847c25 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22392025-06-18T18:47:08.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8e56eaa8-f51f-4b81-a717-fd7df998c659 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22402025-06-18T18:47:08.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8e56eaa8-f51f-4b81-a717-fd7df998c659 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22412025-06-18T18:47:08.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2293 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8e56eaa8-f51f-4b81-a717-fd7df998c659 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22422025-06-18T18:47:09.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 293ca0b7-a90a-4766-ac65-6513eb8a8beb roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22432025-06-18T18:47:09.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 293ca0b7-a90a-4766-ac65-6513eb8a8beb resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22442025-06-18T18:47:09.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2107 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 293ca0b7-a90a-4766-ac65-6513eb8a8beb response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22452025-06-18T18:47:10.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ff7441a3-8617-4b74-97a9-0e962cb2cd3f roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22462025-06-18T18:47:10.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ff7441a3-8617-4b74-97a9-0e962cb2cd3f resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22472025-06-18T18:47:10.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2168 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ff7441a3-8617-4b74-97a9-0e962cb2cd3f response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22482025-06-18T18:47:11.132ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 505 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 5846a74a-0200-4ce9-9377-56df21c2b806 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
22492025-06-18T18:47:11.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 367460f3-77a3-4413-88d5-6c57f9fd9de1 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22502025-06-18T18:47:11.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 367460f3-77a3-4413-88d5-6c57f9fd9de1 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22512025-06-18T18:47:11.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1830 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 367460f3-77a3-4413-88d5-6c57f9fd9de1 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22522025-06-18T18:47:12.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3844d53f-e623-4999-a560-6662422149f4 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22532025-06-18T18:47:12.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3844d53f-e623-4999-a560-6662422149f4 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22542025-06-18T18:47:12.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2600 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3844d53f-e623-4999-a560-6662422149f4 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22552025-06-18T18:47:13.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e6fd3c2b-ae3c-432a-a990-3e74be981323 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22562025-06-18T18:47:13.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e6fd3c2b-ae3c-432a-a990-3e74be981323 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22572025-06-18T18:47:13.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2708 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e6fd3c2b-ae3c-432a-a990-3e74be981323 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22582025-06-18T18:47:14.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 2222903f-470f-4ac4-b109-5c691547e1d3 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22592025-06-18T18:47:14.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 2222903f-470f-4ac4-b109-5c691547e1d3 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22602025-06-18T18:47:14.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2563 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 2222903f-470f-4ac4-b109-5c691547e1d3 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22612025-06-18T18:47:15.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 68b1750e-fb56-46ee-b738-62f0caf59b3f roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22622025-06-18T18:47:15.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 68b1750e-fb56-46ee-b738-62f0caf59b3f resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22632025-06-18T18:47:15.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2330 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 68b1750e-fb56-46ee-b738-62f0caf59b3f response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22642025-06-18T18:47:16.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 47fb16ae-e441-400e-b8ba-982edf0c3e5d roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22652025-06-18T18:47:16.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 47fb16ae-e441-400e-b8ba-982edf0c3e5d resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22662025-06-18T18:47:16.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 7822 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 47fb16ae-e441-400e-b8ba-982edf0c3e5d response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
22672025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
22682025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22692025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
22702025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
22712025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
22722025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
22732025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
22742025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
22752025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
22762025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
22772025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
22782025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22792025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
22802025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22812025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22822025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 24 reason = Timeout
22832025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
22842025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
22852025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
22862025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22872025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
22882025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22892025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22902025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
22912025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22922025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22932025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
22942025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22952025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
22962025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
22972025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22982025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
22992025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
23002025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23012025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
23022025-06-18T18:47:17.558ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
23032025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23042025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
23052025-06-18T18:47:17.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23062025-06-18T18:47:17.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23072025-06-18T18:47:17.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
23082025-06-18T18:47:17.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
23092025-06-18T18:47:17.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23102025-06-18T18:47:17.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23112025-06-18T18:47:17.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23122025-06-18T18:47:17.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23132025-06-18T18:47:17.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23142025-06-18T18:47:17.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23152025-06-18T18:47:17.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23162025-06-18T18:47:17.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
23172025-06-18T18:47:17.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23182025-06-18T18:47:17.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23192025-06-18T18:47:17.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23202025-06-18T18:47:17.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
23212025-06-18T18:47:17.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
23222025-06-18T18:47:17.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23232025-06-18T18:47:17.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23242025-06-18T18:47:17.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23252025-06-18T18:47:17.562ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23262025-06-18T18:47:17.562ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23272025-06-18T18:47:17.562ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.894344ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
23282025-06-18T18:47:17.562ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23292025-06-18T18:47:17.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23302025-06-18T18:47:17.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23312025-06-18T18:47:17.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23322025-06-18T18:47:17.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
23332025-06-18T18:47:17.565ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
23342025-06-18T18:47:17.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
23352025-06-18T18:47:17.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
23362025-06-18T18:47:17.565ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23372025-06-18T18:47:17.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
23382025-06-18T18:47:17.566ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23392025-06-18T18:47:17.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23402025-06-18T18:47:17.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23412025-06-18T18:47:17.567ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23422025-06-18T18:47:17.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23432025-06-18T18:47:17.568ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23442025-06-18T18:47:17.569ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1627, tv_nsec: 149985755 } })
23452025-06-18T18:47:17.569ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23462025-06-18T18:47:17.569ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
23472025-06-18T18:47:17.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23482025-06-18T18:47:17.569ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23492025-06-18T18:47:17.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
23502025-06-18T18:47:17.571ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23512025-06-18T18:47:17.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23522025-06-18T18:47:17.572ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23532025-06-18T18:47:17.572ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23542025-06-18T18:47:17.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23552025-06-18T18:47:17.572ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 14.358278ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
23562025-06-18T18:47:17.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23572025-06-18T18:47:17.574ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1627, tv_nsec: 155421930 } })
23582025-06-18T18:47:17.575ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
23592025-06-18T18:47:17.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23602025-06-18T18:47:17.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23612025-06-18T18:47:17.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23622025-06-18T18:47:17.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23632025-06-18T18:47:17.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23642025-06-18T18:47:17.576ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23652025-06-18T18:47:17.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23662025-06-18T18:47:17.576ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 18.246292ms iteration = 24 status = {"errors":[],"requests_created_ok":[]}
23672025-06-18T18:47:17.579ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 20.31838ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23682025-06-18T18:47:17.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23692025-06-18T18:47:17.580ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1627, tv_nsec: 161213330 } })
23702025-06-18T18:47:17.580ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
23712025-06-18T18:47:17.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23722025-06-18T18:47:17.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23732025-06-18T18:47:17.582ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23742025-06-18T18:47:17.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23752025-06-18T18:47:17.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23762025-06-18T18:47:17.584ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23772025-06-18T18:47:17.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23782025-06-18T18:47:17.586ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23792025-06-18T18:47:17.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23802025-06-18T18:47:17.597ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 39.374303ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
23812025-06-18T18:47:17.603ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23822025-06-18T18:47:17.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23832025-06-18T18:47:17.606ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 47.596396ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23842025-06-18T18:47:17.607ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
23852025-06-18T18:47:17.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
23862025-06-18T18:47:17.608ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23872025-06-18T18:47:17.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23882025-06-18T18:47:17.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23892025-06-18T18:47:17.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
23902025-06-18T18:47:17.611ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
23912025-06-18T18:47:17.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
23922025-06-18T18:47:17.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23932025-06-18T18:47:17.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23942025-06-18T18:47:17.615ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23952025-06-18T18:47:17.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9fbbc826-5b83-4b80-8172-66302c618aae, lookup_type: ById(9fbbc826-5b83-4b80-8172-66302c618aae) } result = Ok(())
23962025-06-18T18:47:17.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23972025-06-18T18:47:17.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23982025-06-18T18:47:17.619ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 61.211764ms iteration = 24 status = 0
23992025-06-18T18:47:17.622ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24002025-06-18T18:47:17.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24012025-06-18T18:47:17.623ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24022025-06-18T18:47:17.623ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24032025-06-18T18:47:17.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24042025-06-18T18:47:17.628ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 70.247289ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
24052025-06-18T18:47:17.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
24062025-06-18T18:47:17.629ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24072025-06-18T18:47:17.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24082025-06-18T18:47:17.631ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
24092025-06-18T18:47:17.631ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.664813ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
24102025-06-18T18:47:17.633ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24112025-06-18T18:47:17.633ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
24122025-06-18T18:47:17.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24132025-06-18T18:47:17.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24142025-06-18T18:47:17.636ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24152025-06-18T18:47:17.636ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
24162025-06-18T18:47:17.636ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24172025-06-18T18:47:17.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24182025-06-18T18:47:17.644ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
24192025-06-18T18:47:17.644ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.883265ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
24202025-06-18T18:47:17.647ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
24212025-06-18T18:47:17.647ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 88.902157ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
24222025-06-18T18:47:17.648ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
24232025-06-18T18:47:17.648ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24242025-06-18T18:47:17.649ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1fc5cef-5616-4b5d-ae3a-c26b3caca02f", "content-length": "26", "date": "Wed, 18 Jun 2025 18:47:17 GMT"} })
24252025-06-18T18:47:17.649ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24262025-06-18T18:47:17.651ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24272025-06-18T18:47:17.662ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 103.960194ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
24282025-06-18T18:47:17.667ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
24292025-06-18T18:47:17.667ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24302025-06-18T18:47:17.668ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ce91ad4-7fbe-4fce-9b32-2d1f816c0970", "content-length": "26", "date": "Wed, 18 Jun 2025 18:47:17 GMT"} })
24312025-06-18T18:47:17.668ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24322025-06-18T18:47:17.669ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24332025-06-18T18:47:17.669ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24342025-06-18T18:47:17.669ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 110.771868ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
24352025-06-18T18:47:17.669ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24362025-06-18T18:47:17.678ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f zone_address = fd00:1122:3344:101::2
24372025-06-18T18:47:17.678ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24382025-06-18T18:47:17.678ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa3ce6d9-4811-4b3f-8495-3bd110d31b6c", "content-length": "26", "date": "Wed, 18 Jun 2025 18:47:17 GMT"} })
24392025-06-18T18:47:17.678ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24402025-06-18T18:47:17.679ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
24412025-06-18T18:47:17.679ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24422025-06-18T18:47:17.679ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d770806-baba-43a0-a491-97aac54a66dd", "content-length": "372", "date": "Wed, 18 Jun 2025 18:47:17 GMT"} })
24432025-06-18T18:47:17.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24442025-06-18T18:47:17.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24452025-06-18T18:47:17.679ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
24462025-06-18T18:47:17.680ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24472025-06-18T18:47:17.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24482025-06-18T18:47:17.687ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24492025-06-18T18:47:17.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24502025-06-18T18:47:17.694ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
24512025-06-18T18:47:17.694ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
24522025-06-18T18:47:17.694ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2c048919-9efd-43c1-9df9-001fe5cebc5b", "date": "Wed, 18 Jun 2025 18:47:17 GMT"} })
24532025-06-18T18:47:17.694ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24542025-06-18T18:47:17.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24552025-06-18T18:47:17.695ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24562025-06-18T18:47:17.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24572025-06-18T18:47:17.698ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24582025-06-18T18:47:17.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24592025-06-18T18:47:17.701ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
24602025-06-18T18:47:17.701ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24612025-06-18T18:47:17.701ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0ab93c1a-6bdc-4961-8acf-8dd36e7fe149", "date": "Wed, 18 Jun 2025 18:47:17 GMT"} })
24622025-06-18T18:47:17.703ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 144.273201ms iteration = 24 status = {}
24632025-06-18T18:47:17.707ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 148.362027ms iteration = 27 status = {"physical_disks_added":0}
24642025-06-18T18:47:17.722ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24652025-06-18T18:47:17.724ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24662025-06-18T18:47:17.724ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24672025-06-18T18:47:17.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24682025-06-18T18:47:17.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24692025-06-18T18:47:17.728ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24702025-06-18T18:47:17.728ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24712025-06-18T18:47:17.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24722025-06-18T18:47:17.742ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 183.728095ms iteration = 24 status = {}
24732025-06-18T18:47:17.743ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24742025-06-18T18:47:17.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24752025-06-18T18:47:17.745ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 186.880678ms iteration = 24 status = null
24762025-06-18T18:47:17.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c350d0f2-d9f1-4dd9-955d-f2aae30bf623 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
24772025-06-18T18:47:17.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c350d0f2-d9f1-4dd9-955d-f2aae30bf623 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
24782025-06-18T18:47:17.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1640 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c350d0f2-d9f1-4dd9-955d-f2aae30bf623 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
24792025-06-18T18:47:17.775ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24802025-06-18T18:47:17.775ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d699ecf-176b-4b3e-aed6-bd76095f6797", "content-length": "691", "date": "Wed, 18 Jun 2025 18:47:17 GMT"} })
24812025-06-18T18:47:17.775ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
24822025-06-18T18:47:17.775ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
24832025-06-18T18:47:17.775ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
24842025-06-18T18:47:17.776ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 218.21679ms iteration = 24 status = {}
24852025-06-18T18:47:17.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24862025-06-18T18:47:17.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24872025-06-18T18:47:17.814ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 7e1ff921-047f-464e-8081-f8132af716ac, rack_id: 3a330d2e-6212-46a4-9781-374fdb3dc92f, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(6c07c314-d66b-4041-9040-d774200d26a9) } rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
24882025-06-18T18:47:17.814ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24892025-06-18T18:47:17.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24902025-06-18T18:47:17.826ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
24912025-06-18T18:47:17.826ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 6c07c314-d66b-4041-9040-d774200d26a9
24922025-06-18T18:47:17.827ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
24932025-06-18T18:47:17.827ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24942025-06-18T18:47:17.827ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24952025-06-18T18:47:17.827ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24962025-06-18T18:47:17.827ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24972025-06-18T18:47:17.827ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24982025-06-18T18:47:17.827ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24992025-06-18T18:47:17.827ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25002025-06-18T18:47:17.827ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
25012025-06-18T18:47:17.827ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25022025-06-18T18:47:17.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25032025-06-18T18:47:17.829ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
25042025-06-18T18:47:17.829ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
25052025-06-18T18:47:17.927ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9b2fbb08-6a62-47f2-94e8-a4b14dc1e7e4", "date": "Wed, 18 Jun 2025 18:47:17 GMT"} })
25062025-06-18T18:47:17.927ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch = Switch0
25072025-06-18T18:47:17.927ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
25082025-06-18T18:47:17.927ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "73d9144d-aa6b-4059-b667-ba0ff3930895", "content-length": "682", "date": "Wed, 18 Jun 2025 18:47:17 GMT"} })
25092025-06-18T18:47:17.927ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25102025-06-18T18:47:17.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25112025-06-18T18:47:17.931ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25122025-06-18T18:47:17.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25132025-06-18T18:47:17.935ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25142025-06-18T18:47:17.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25152025-06-18T18:47:17.938ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25162025-06-18T18:47:17.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25172025-06-18T18:47:17.944ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 386.073436ms iteration = 24 status = {}
25182025-06-18T18:47:18.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1a763a38-7781-46c8-9d1e-c37b5f41167b roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25192025-06-18T18:47:18.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1a763a38-7781-46c8-9d1e-c37b5f41167b resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25202025-06-18T18:47:18.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2550 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1a763a38-7781-46c8-9d1e-c37b5f41167b response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25212025-06-18T18:47:19.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4ba14d92-a652-47f9-909c-01e86c5c8f5e roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25222025-06-18T18:47:19.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4ba14d92-a652-47f9-909c-01e86c5c8f5e resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25232025-06-18T18:47:19.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2153 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4ba14d92-a652-47f9-909c-01e86c5c8f5e response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25242025-06-18T18:47:20.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 972da8ab-8530-4fa8-8675-7da8ec53875e roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25252025-06-18T18:47:20.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 972da8ab-8530-4fa8-8675-7da8ec53875e resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25262025-06-18T18:47:20.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2260 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 972da8ab-8530-4fa8-8675-7da8ec53875e response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25272025-06-18T18:47:21.124ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:39667
25282025-06-18T18:47:21.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39667 req_id = 71c85016-41df-41e1-86d8-6389d6247422 roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
25292025-06-18T18:47:21.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39667 req_id = 71c85016-41df-41e1-86d8-6389d6247422 resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
25302025-06-18T18:47:21.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3100 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39667 req_id = 71c85016-41df-41e1-86d8-6389d6247422 response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
25312025-06-18T18:47:21.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39667 req_id = 3c1353ed-db5b-44d8-a677-104a201a0c0f roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
25322025-06-18T18:47:21.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39667 req_id = 3c1353ed-db5b-44d8-a677-104a201a0c0f resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
25332025-06-18T18:47:21.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2476 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39667 req_id = 3c1353ed-db5b-44d8-a677-104a201a0c0f response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
25342025-06-18T18:47:21.132ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 492 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = fd8c5dc0-69c8-43da-aa10-22915ac5c4ac response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
25352025-06-18T18:47:21.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 27cc3f13-87db-4406-9325-ad7299163054 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25362025-06-18T18:47:21.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 27cc3f13-87db-4406-9325-ad7299163054 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25372025-06-18T18:47:21.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2197 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 27cc3f13-87db-4406-9325-ad7299163054 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25382025-06-18T18:47:22.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9df82989-9213-48d7-a239-bca4e3d7eb1c roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25392025-06-18T18:47:22.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9df82989-9213-48d7-a239-bca4e3d7eb1c resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25402025-06-18T18:47:22.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2559 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9df82989-9213-48d7-a239-bca4e3d7eb1c response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25412025-06-18T18:47:23.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d3516dcf-518e-493e-add9-ddfe8258dda7 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25422025-06-18T18:47:23.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d3516dcf-518e-493e-add9-ddfe8258dda7 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25432025-06-18T18:47:23.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1984 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d3516dcf-518e-493e-add9-ddfe8258dda7 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25442025-06-18T18:47:24.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7cd7a336-a715-470e-8ae5-2ae34359927f roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25452025-06-18T18:47:24.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7cd7a336-a715-470e-8ae5-2ae34359927f resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25462025-06-18T18:47:24.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2430 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7cd7a336-a715-470e-8ae5-2ae34359927f response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25472025-06-18T18:47:25.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 036468af-554e-473e-9797-00a475ce97b2 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25482025-06-18T18:47:25.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 036468af-554e-473e-9797-00a475ce97b2 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25492025-06-18T18:47:25.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2693 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 036468af-554e-473e-9797-00a475ce97b2 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25502025-06-18T18:47:26.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f78d67f7-8294-4109-8206-f2cd5db2b9ed roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25512025-06-18T18:47:26.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f78d67f7-8294-4109-8206-f2cd5db2b9ed resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25522025-06-18T18:47:26.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1989 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f78d67f7-8294-4109-8206-f2cd5db2b9ed response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25532025-06-18T18:47:27.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
25542025-06-18T18:47:27.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
25552025-06-18T18:47:27.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25562025-06-18T18:47:27.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25572025-06-18T18:47:27.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25582025-06-18T18:47:27.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25592025-06-18T18:47:27.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25602025-06-18T18:47:27.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25612025-06-18T18:47:27.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25622025-06-18T18:47:27.562ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.704012ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25632025-06-18T18:47:27.563ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25642025-06-18T18:47:27.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25652025-06-18T18:47:27.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25662025-06-18T18:47:27.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25672025-06-18T18:47:27.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25682025-06-18T18:47:27.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25692025-06-18T18:47:27.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
25702025-06-18T18:47:27.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25712025-06-18T18:47:27.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25722025-06-18T18:47:27.578ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
25732025-06-18T18:47:27.578ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.368001ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
25742025-06-18T18:47:27.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5dd3f7dc-2f18-49b4-83e9-c7c79c4882e7 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25752025-06-18T18:47:27.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5dd3f7dc-2f18-49b4-83e9-c7c79c4882e7 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25762025-06-18T18:47:27.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2173 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5dd3f7dc-2f18-49b4-83e9-c7c79c4882e7 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25772025-06-18T18:47:28.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c51259d7-bedc-42cf-81f8-ad31076e9a50 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25782025-06-18T18:47:28.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c51259d7-bedc-42cf-81f8-ad31076e9a50 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25792025-06-18T18:47:28.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1940 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c51259d7-bedc-42cf-81f8-ad31076e9a50 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25802025-06-18T18:47:30.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 670c79dd-4024-4462-98c2-6e1ac4230ad3 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25812025-06-18T18:47:30.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 670c79dd-4024-4462-98c2-6e1ac4230ad3 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25822025-06-18T18:47:30.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2265 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 670c79dd-4024-4462-98c2-6e1ac4230ad3 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25832025-06-18T18:47:31.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e7f0e8e0-c196-4e04-9c5c-18713492eb4a roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25842025-06-18T18:47:31.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e7f0e8e0-c196-4e04-9c5c-18713492eb4a resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25852025-06-18T18:47:31.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2342 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e7f0e8e0-c196-4e04-9c5c-18713492eb4a response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25862025-06-18T18:47:31.133ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 528 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 3e0da212-4b10-4fdb-bb4b-1b0b46e7283d response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
25872025-06-18T18:47:32.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bcad8eab-14f4-4bf5-86c1-16cf88601b14 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25882025-06-18T18:47:32.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bcad8eab-14f4-4bf5-86c1-16cf88601b14 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25892025-06-18T18:47:32.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2199 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bcad8eab-14f4-4bf5-86c1-16cf88601b14 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25902025-06-18T18:47:33.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = da8f5236-9b4b-4f06-9d3d-0d75c2615c97 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25912025-06-18T18:47:33.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = da8f5236-9b4b-4f06-9d3d-0d75c2615c97 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25922025-06-18T18:47:33.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2397 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = da8f5236-9b4b-4f06-9d3d-0d75c2615c97 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25932025-06-18T18:47:34.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 436933b9-e6a6-48b4-858d-7b206a05424d roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25942025-06-18T18:47:34.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 436933b9-e6a6-48b4-858d-7b206a05424d resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25952025-06-18T18:47:34.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3031 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 436933b9-e6a6-48b4-858d-7b206a05424d response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25962025-06-18T18:47:35.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 418005f9-7848-4438-ae88-c6898760fe46 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25972025-06-18T18:47:35.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 418005f9-7848-4438-ae88-c6898760fe46 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25982025-06-18T18:47:35.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2451 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 418005f9-7848-4438-ae88-c6898760fe46 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
25992025-06-18T18:47:36.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ffe2f17b-7a37-4b53-b559-7b6854da0d65 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26002025-06-18T18:47:36.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ffe2f17b-7a37-4b53-b559-7b6854da0d65 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26012025-06-18T18:47:36.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2817 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ffe2f17b-7a37-4b53-b559-7b6854da0d65 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26022025-06-18T18:47:37.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 065d4939-141a-4920-a9ff-2f5530a94bd4 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26032025-06-18T18:47:37.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 065d4939-141a-4920-a9ff-2f5530a94bd4 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26042025-06-18T18:47:37.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1852 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 065d4939-141a-4920-a9ff-2f5530a94bd4 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26052025-06-18T18:47:37.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
26062025-06-18T18:47:37.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
26072025-06-18T18:47:37.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26082025-06-18T18:47:37.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26092025-06-18T18:47:37.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26102025-06-18T18:47:37.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26112025-06-18T18:47:37.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26122025-06-18T18:47:37.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26132025-06-18T18:47:37.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26142025-06-18T18:47:37.563ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.453742ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26152025-06-18T18:47:37.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26162025-06-18T18:47:37.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26172025-06-18T18:47:37.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26182025-06-18T18:47:37.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26192025-06-18T18:47:37.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26202025-06-18T18:47:37.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26212025-06-18T18:47:37.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
26222025-06-18T18:47:37.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26232025-06-18T18:47:37.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26242025-06-18T18:47:37.580ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
26252025-06-18T18:47:37.581ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.836751ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
26262025-06-18T18:47:38.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6aeebf6c-7314-45b0-8048-c633400d5a2c roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26272025-06-18T18:47:38.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6aeebf6c-7314-45b0-8048-c633400d5a2c resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26282025-06-18T18:47:38.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2312 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6aeebf6c-7314-45b0-8048-c633400d5a2c response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26292025-06-18T18:47:39.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6b2eb687-6021-4dee-8b9c-17d7e91f75f9 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26302025-06-18T18:47:39.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6b2eb687-6021-4dee-8b9c-17d7e91f75f9 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26312025-06-18T18:47:39.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2718 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6b2eb687-6021-4dee-8b9c-17d7e91f75f9 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26322025-06-18T18:47:39.532ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 76d75268-c3fa-41e3-936e-d2506da5c6a4 remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 57e0c38e-9cae-49cb-a2fa-afcf8b84b0da uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-06-18T18:47:39.517624342Z }
26332025-06-18T18:47:39.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 57e0c38e-9cae-49cb-a2fa-afcf8b84b0da roles = RoleSet { roles: {} } uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
26342025-06-18T18:47:39.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 57e0c38e-9cae-49cb-a2fa-afcf8b84b0da resource = Database result = Ok(()) uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
26352025-06-18T18:47:39.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 46310 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 57e0c38e-9cae-49cb-a2fa-afcf8b84b0da response_code = 204 uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
26362025-06-18T18:47:39.591ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 76d75268-c3fa-41e3-936e-d2506da5c6a4 remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 50f0095a-5034-4f30-8d4e-9dae3d06564a uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-06-18T18:47:39.590863232Z }
26372025-06-18T18:47:39.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 50f0095a-5034-4f30-8d4e-9dae3d06564a roles = RoleSet { roles: {} } uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
26382025-06-18T18:47:39.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 50f0095a-5034-4f30-8d4e-9dae3d06564a resource = Database result = Ok(()) uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
26392025-06-18T18:47:39.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 10929 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 50f0095a-5034-4f30-8d4e-9dae3d06564a response_code = 204 uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
26402025-06-18T18:47:40.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8b097cd1-2979-419c-bf31-425c130a8a0e roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26412025-06-18T18:47:40.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8b097cd1-2979-419c-bf31-425c130a8a0e resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26422025-06-18T18:47:40.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2232 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8b097cd1-2979-419c-bf31-425c130a8a0e response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26432025-06-18T18:47:41.133ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 613 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 37d5ff9d-c3af-4bbe-b5c2-666304ba3c04 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
26442025-06-18T18:47:41.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 566c8ece-5578-435d-a4ea-86de3abc7f0b roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26452025-06-18T18:47:41.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 566c8ece-5578-435d-a4ea-86de3abc7f0b resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26462025-06-18T18:47:41.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2277 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 566c8ece-5578-435d-a4ea-86de3abc7f0b response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26472025-06-18T18:47:42.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = fbed840a-780a-4439-b06f-5a4edb9366c6 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26482025-06-18T18:47:42.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = fbed840a-780a-4439-b06f-5a4edb9366c6 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26492025-06-18T18:47:42.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1965 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = fbed840a-780a-4439-b06f-5a4edb9366c6 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26502025-06-18T18:47:43.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = fb628299-83ef-4068-b139-d9ca04306756 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26512025-06-18T18:47:43.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = fb628299-83ef-4068-b139-d9ca04306756 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26522025-06-18T18:47:43.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2468 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = fb628299-83ef-4068-b139-d9ca04306756 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26532025-06-18T18:47:44.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f8cf562c-a7c1-4cb3-96e4-f0e5bc6d569f roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26542025-06-18T18:47:44.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f8cf562c-a7c1-4cb3-96e4-f0e5bc6d569f resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26552025-06-18T18:47:44.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2343 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f8cf562c-a7c1-4cb3-96e4-f0e5bc6d569f response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26562025-06-18T18:47:45.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 343f481a-01f4-416a-a7d0-15158d018fb7 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26572025-06-18T18:47:45.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 343f481a-01f4-416a-a7d0-15158d018fb7 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26582025-06-18T18:47:45.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2029 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 343f481a-01f4-416a-a7d0-15158d018fb7 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26592025-06-18T18:47:46.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = be3a07a9-069b-4814-ba1c-4a48dca29d5d roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26602025-06-18T18:47:46.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = be3a07a9-069b-4814-ba1c-4a48dca29d5d resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26612025-06-18T18:47:46.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2766 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = be3a07a9-069b-4814-ba1c-4a48dca29d5d response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26622025-06-18T18:47:47.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1808bff6-fc16-432e-8e92-6aad2c750233 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26632025-06-18T18:47:47.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1808bff6-fc16-432e-8e92-6aad2c750233 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26642025-06-18T18:47:47.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2254 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1808bff6-fc16-432e-8e92-6aad2c750233 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
26652025-06-18T18:47:47.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
26662025-06-18T18:47:47.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26672025-06-18T18:47:47.558ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
26682025-06-18T18:47:47.558ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
26692025-06-18T18:47:47.558ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 13 reason = Timeout
26702025-06-18T18:47:47.558ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
26712025-06-18T18:47:47.558ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
26722025-06-18T18:47:47.558ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
26732025-06-18T18:47:47.558ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
26742025-06-18T18:47:47.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26752025-06-18T18:47:47.558ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
26762025-06-18T18:47:47.558ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
26772025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26782025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
26792025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
26802025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
26812025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
26822025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
26832025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
26842025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
26852025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26862025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
26872025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26882025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
26892025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
26902025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
26912025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26922025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26932025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
26942025-06-18T18:47:47.559ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
26952025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26962025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
26972025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
26982025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
26992025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
27002025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27012025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
27022025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
27032025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
27042025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
27052025-06-18T18:47:47.559ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe
27062025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.95\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe"}
27072025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
27082025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
27092025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
27102025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
27112025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
27122025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
27132025-06-18T18:47:47.559ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-18 18:37:47.559397993 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
27142025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27152025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
27162025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 25 reason = Timeout
27172025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
27182025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
27192025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
27202025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27212025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
27222025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
27232025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
27242025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
27252025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
27262025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
27272025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27282025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
27292025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
27302025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27312025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27322025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
27332025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27342025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
27352025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27362025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
27372025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27382025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
27392025-06-18T18:47:47.559ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
27402025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27412025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
27422025-06-18T18:47:47.559ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
27432025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 13 reason = Timeout
27442025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
27452025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
27462025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27472025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
27482025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27492025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27502025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
27512025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
27522025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
27532025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27542025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
27552025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
27562025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27572025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
27582025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27592025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
27602025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27612025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27622025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27632025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27642025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
27652025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
27662025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27672025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27682025-06-18T18:47:47.560ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("03fce462-e4e1-4a86-890b-8a2ae9e17168.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("800703b5-0601-4ce2-acc3-d5b9ca473160.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("800703b5-0601-4ce2-acc3-d5b9ca473160.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1657, tv_nsec: 140469716 } })
27692025-06-18T18:47:47.560ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("51411444-5ad0-46e8-b345-7ee26fb32a60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("adea75c9-2ff2-4f9f-bfac-48c7702333e0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea7c6eed-68db-4cd0-929a-17b08777d263.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea7c6eed-68db-4cd0-929a-17b08777d263.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1657, tv_nsec: 140478446 } })
27702025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
27712025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
27722025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27732025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
27742025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
27752025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
27762025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
27772025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.38727ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
27782025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
27792025-06-18T18:47:47.560ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.673153ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
27802025-06-18T18:47:47.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27812025-06-18T18:47:47.561ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27822025-06-18T18:47:47.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
27832025-06-18T18:47:47.562ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.089356ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
27842025-06-18T18:47:47.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27852025-06-18T18:47:47.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27862025-06-18T18:47:47.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27872025-06-18T18:47:47.566ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27882025-06-18T18:47:47.567ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27892025-06-18T18:47:47.568ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27902025-06-18T18:47:47.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
27912025-06-18T18:47:47.568ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
27922025-06-18T18:47:47.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
27932025-06-18T18:47:47.570ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27942025-06-18T18:47:47.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
27952025-06-18T18:47:47.570ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
27962025-06-18T18:47:47.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
27972025-06-18T18:47:47.571ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
27982025-06-18T18:47:47.571ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27992025-06-18T18:47:47.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28002025-06-18T18:47:47.572ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-18 18:37:47.559397993 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
28012025-06-18T18:47:47.572ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.201232ms iteration = 13 status = {"expiration":"2025-06-18T18:37:47.559397993Z","pruned":[]}
28022025-06-18T18:47:47.572ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28032025-06-18T18:47:47.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
28042025-06-18T18:47:47.573ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28052025-06-18T18:47:47.573ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28062025-06-18T18:47:47.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28072025-06-18T18:47:47.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
28082025-06-18T18:47:47.575ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
28092025-06-18T18:47:47.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
28102025-06-18T18:47:47.575ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 16.497748ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
28112025-06-18T18:47:47.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
28122025-06-18T18:47:47.576ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
28132025-06-18T18:47:47.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
28142025-06-18T18:47:47.576ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.39707ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
28152025-06-18T18:47:47.577ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28162025-06-18T18:47:47.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28172025-06-18T18:47:47.579ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1657, tv_nsec: 159341477 } })
28182025-06-18T18:47:47.579ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28192025-06-18T18:47:47.579ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
28202025-06-18T18:47:47.580ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1657, tv_nsec: 160668395 } })
28212025-06-18T18:47:47.580ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
28222025-06-18T18:47:47.581ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28232025-06-18T18:47:47.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28242025-06-18T18:47:47.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28252025-06-18T18:47:47.582ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
28262025-06-18T18:47:47.582ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 23.19098ms iteration = 13 status = {"by_rx":{},"error":null}
28272025-06-18T18:47:47.583ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28282025-06-18T18:47:47.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28292025-06-18T18:47:47.584ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28302025-06-18T18:47:47.584ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28312025-06-18T18:47:47.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28322025-06-18T18:47:47.587ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28332025-06-18T18:47:47.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
28342025-06-18T18:47:47.587ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
28352025-06-18T18:47:47.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28362025-06-18T18:47:47.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
28372025-06-18T18:47:47.587ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28382025-06-18T18:47:47.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
28392025-06-18T18:47:47.589ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
28402025-06-18T18:47:47.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
28412025-06-18T18:47:47.589ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28422025-06-18T18:47:47.590ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
28432025-06-18T18:47:47.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
28442025-06-18T18:47:47.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
28452025-06-18T18:47:47.592ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
28462025-06-18T18:47:47.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
28472025-06-18T18:47:47.594ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28482025-06-18T18:47:47.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28492025-06-18T18:47:47.595ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
28502025-06-18T18:47:47.595ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
28512025-06-18T18:47:47.595ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 36.746117ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
28522025-06-18T18:47:47.595ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28532025-06-18T18:47:47.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28542025-06-18T18:47:47.597ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28552025-06-18T18:47:47.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28562025-06-18T18:47:47.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28572025-06-18T18:47:47.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28582025-06-18T18:47:47.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
28592025-06-18T18:47:47.602ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28602025-06-18T18:47:47.602ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28612025-06-18T18:47:47.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28622025-06-18T18:47:47.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28632025-06-18T18:47:47.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28642025-06-18T18:47:47.603ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 44.248361ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
28652025-06-18T18:47:47.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28662025-06-18T18:47:47.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 44.855809ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28672025-06-18T18:47:47.606ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 47.590977ms iteration = 13 status = {"dispatched":[],"errors":[],"glob_version":"150.0.0","globs_reprocessed":{},"no_receivers":[]}
28682025-06-18T18:47:47.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
28692025-06-18T18:47:47.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28702025-06-18T18:47:47.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28712025-06-18T18:47:47.611ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 52.106839ms iteration = 6 status = {"nsuccess":5}
28722025-06-18T18:47:47.613ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28732025-06-18T18:47:47.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
28742025-06-18T18:47:47.619ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28752025-06-18T18:47:47.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28762025-06-18T18:47:47.623ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28772025-06-18T18:47:47.623ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
28782025-06-18T18:47:47.623ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28792025-06-18T18:47:47.623ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28802025-06-18T18:47:47.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28812025-06-18T18:47:47.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28822025-06-18T18:47:47.626ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28832025-06-18T18:47:47.626ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 66.965194ms iteration = 25 status = {"errors":[],"requests_created_ok":[]}
28842025-06-18T18:47:47.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
28852025-06-18T18:47:47.628ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28862025-06-18T18:47:47.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28872025-06-18T18:47:47.630ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28882025-06-18T18:47:47.633ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
28892025-06-18T18:47:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
28902025-06-18T18:47:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
28912025-06-18T18:47:47.640ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28922025-06-18T18:47:47.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28932025-06-18T18:47:47.645ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
28942025-06-18T18:47:47.645ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
28952025-06-18T18:47:47.645ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 86.413442ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
28962025-06-18T18:47:47.646ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
28972025-06-18T18:47:47.646ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
28982025-06-18T18:47:47.646ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
28992025-06-18T18:47:47.646ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29002025-06-18T18:47:47.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29012025-06-18T18:47:47.652ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29022025-06-18T18:47:47.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
29032025-06-18T18:47:47.655ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29042025-06-18T18:47:47.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29052025-06-18T18:47:47.666ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
29062025-06-18T18:47:47.666ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
29072025-06-18T18:47:47.666ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
29082025-06-18T18:47:47.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29092025-06-18T18:47:47.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29102025-06-18T18:47:47.672ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
29112025-06-18T18:47:47.677ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
29122025-06-18T18:47:47.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
29132025-06-18T18:47:47.682ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
29142025-06-18T18:47:47.710ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29152025-06-18T18:47:47.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29162025-06-18T18:47:47.729ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
29172025-06-18T18:47:47.729ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29182025-06-18T18:47:47.729ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "64c47cf0-c866-4e9b-a91c-0ddde6d8bbc8", "content-length": "26", "date": "Wed, 18 Jun 2025 18:47:47 GMT"} })
29192025-06-18T18:47:47.729ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29202025-06-18T18:47:47.731ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29212025-06-18T18:47:47.810ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
29222025-06-18T18:47:47.829ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
29232025-06-18T18:47:47.829ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
29242025-06-18T18:47:47.830ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "de364ab3-61a1-4f67-9648-a04d1fc11a51", "content-length": "26", "date": "Wed, 18 Jun 2025 18:47:47 GMT"} })
29252025-06-18T18:47:47.830ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
29262025-06-18T18:47:47.832ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
29272025-06-18T18:47:47.838ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
29282025-06-18T18:47:47.839ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "41eb1081-d40e-4cee-a1fd-57d2c3935a95", "date": "Wed, 18 Jun 2025 18:47:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29292025-06-18T18:47:47.839ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29302025-06-18T18:47:47.840ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "97be2d91-ae17-410e-9c61-fdbc81bc14ec", "date": "Wed, 18 Jun 2025 18:47:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29312025-06-18T18:47:47.840ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29322025-06-18T18:47:47.843ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
29332025-06-18T18:47:47.843ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 283.954128ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
29342025-06-18T18:47:47.856ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4/state
29352025-06-18T18:47:47.857ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29362025-06-18T18:47:47.858ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "c118997d-9446-4b24-9367-d3f3635dfc19", "content-length": "130", "date": "Wed, 18 Jun 2025 18:47:47 GMT"} })
29372025-06-18T18:47:47.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29382025-06-18T18:47:47.860ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29392025-06-18T18:47:47.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29402025-06-18T18:47:47.860ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 sled_id = 9fbbc826-5b83-4b80-8172-66302c618aae state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-06-18T18:47:39.590863232Z }, migration_in: None, migration_out: None } vmm_id = 76d75268-c3fa-41e3-936e-d2506da5c6a4
29412025-06-18T18:47:47.860ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2140 instance_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 76d75268-c3fa-41e3-936e-d2506da5c6a4 sled_id = 9fbbc826-5b83-4b80-8172-66302c618aae vmm_id = 76d75268-c3fa-41e3-936e-d2506da5c6a4 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-06-18T18:47:39.590863232Z }
29422025-06-18T18:47:47.860ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 roles = RoleSet { roles: {} } sled_id = 9fbbc826-5b83-4b80-8172-66302c618aae vmm_id = 76d75268-c3fa-41e3-936e-d2506da5c6a4
29432025-06-18T18:47:47.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 resource = Database result = Ok(()) sled_id = 9fbbc826-5b83-4b80-8172-66302c618aae vmm_id = 76d75268-c3fa-41e3-936e-d2506da5c6a4
29442025-06-18T18:47:47.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29452025-06-18T18:47:47.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29462025-06-18T18:47:47.863ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29472025-06-18T18:47:47.864ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29482025-06-18T18:47:47.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29492025-06-18T18:47:47.864ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1657, tv_nsec: 444830725 } })
29502025-06-18T18:47:47.865ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
29512025-06-18T18:47:47.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
29522025-06-18T18:47:47.866ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29532025-06-18T18:47:47.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29542025-06-18T18:47:47.867ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 307.492132ms iteration = 25 status = {}
29552025-06-18T18:47:47.894ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
29562025-06-18T18:47:47.894ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 335.842183ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
29572025-06-18T18:47:47.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 343.644821ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
29582025-06-18T18:47:47.902ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29592025-06-18T18:47:47.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29602025-06-18T18:47:47.910ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 350.883271ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
29612025-06-18T18:47:47.913ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29622025-06-18T18:47:47.913ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
29632025-06-18T18:47:47.913ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29642025-06-18T18:47:47.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29652025-06-18T18:47:47.916ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
29662025-06-18T18:47:47.916ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29672025-06-18T18:47:47.916ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "bc961aa2-17d4-44ca-91c2-b8a6d88872fb", "date": "Wed, 18 Jun 2025 18:47:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
29682025-06-18T18:47:47.916ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
29692025-06-18T18:47:47.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29702025-06-18T18:47:47.918ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "26ea4e92-5ede-4697-b2eb-c043583050a2", "date": "Wed, 18 Jun 2025 18:47:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
29712025-06-18T18:47:47.919ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
29722025-06-18T18:47:47.919ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29732025-06-18T18:47:47.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29742025-06-18T18:47:47.920ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29752025-06-18T18:47:47.921ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29762025-06-18T18:47:47.921ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3a3b7cbc-642d-440e-a6b9-76c3cd44da86", "date": "Wed, 18 Jun 2025 18:47:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
29772025-06-18T18:47:47.921ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
29782025-06-18T18:47:47.923ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
29792025-06-18T18:47:47.923ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 364.897734ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
29802025-06-18T18:47:47.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
29812025-06-18T18:47:47.924ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29822025-06-18T18:47:47.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29832025-06-18T18:47:47.925ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9fbbc826-5b83-4b80-8172-66302c618aae, lookup_type: ById(9fbbc826-5b83-4b80-8172-66302c618aae) } result = Ok(())
29842025-06-18T18:47:47.925ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29852025-06-18T18:47:47.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29862025-06-18T18:47:47.925ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29872025-06-18T18:47:47.926ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29882025-06-18T18:47:47.926ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
29892025-06-18T18:47:47.927ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 368.589385ms iteration = 25 status = 0
29902025-06-18T18:47:47.928ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
29912025-06-18T18:47:47.928ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29922025-06-18T18:47:47.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29932025-06-18T18:47:47.929ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 369.884643ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
29942025-06-18T18:47:47.929ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29952025-06-18T18:47:47.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29962025-06-18T18:47:47.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
29972025-06-18T18:47:47.932ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29982025-06-18T18:47:47.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29992025-06-18T18:47:47.934ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 374.955503ms iteration = 25 status = null
30002025-06-18T18:47:47.938ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
30012025-06-18T18:47:47.938ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 379.551887ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
30022025-06-18T18:47:47.939ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f zone_address = fd00:1122:3344:101::2
30032025-06-18T18:47:47.939ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30042025-06-18T18:47:47.939ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ad70fb7-512e-463e-8881-a638ea4496a6", "content-length": "26", "date": "Wed, 18 Jun 2025 18:47:47 GMT"} })
30052025-06-18T18:47:47.939ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30062025-06-18T18:47:47.941ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
30072025-06-18T18:47:47.948ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 389.343272ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
30082025-06-18T18:47:47.957ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30092025-06-18T18:47:47.957ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30102025-06-18T18:47:47.957ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 397.605506ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30112025-06-18T18:47:47.963ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
30122025-06-18T18:47:47.963ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 72dd4529-6655-4d30-a1d8-0de429d0133c dns_zone_name = oxide.test found_so_far = 0 version = 2
30132025-06-18T18:47:47.963ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30142025-06-18T18:47:47.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30152025-06-18T18:47:47.967ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-18T18:35:46.206089Z, time_modified: 2025-06-18T18:35:46.206089Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 472c0288-095b-456c-b18f-d5f22a8efd72, db_silo: Silo { identity: SiloIdentity { id: 472c0288-095b-456c-b18f-d5f22a8efd72, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-18T18:36:19.955323Z, time_modified: 2025-06-18T18:36:19.955323Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 472c0288-095b-456c-b18f-d5f22a8efd72, db_silo: Silo { identity: SiloIdentity { id: 472c0288-095b-456c-b18f-d5f22a8efd72, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-18T18:36:19.955323Z, time_modified: 2025-06-18T18:36:19.955323Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
30162025-06-18T18:47:47.967ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 408.157271ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"472c0288-095b-456c-b18f-d5f22a8efd72","tls_certs":["6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3"]}},"default_endpoint":{"silo_id":"472c0288-095b-456c-b18f-d5f22a8efd72","tls_certs":["6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
30172025-06-18T18:47:47.969ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
30182025-06-18T18:47:47.969ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = ab8dd933-5e45-404d-97a3-fdafa1c7d91b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
30192025-06-18T18:47:47.969ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30202025-06-18T18:47:47.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30212025-06-18T18:47:47.993ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 433.785085ms iteration = 28 status = {"physical_disks_added":0}
30222025-06-18T18:47:48.004ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30232025-06-18T18:47:48.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30242025-06-18T18:47:48.017ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
30252025-06-18T18:47:48.017ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30262025-06-18T18:47:48.018ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "676b0eb4-a4de-4a12-a8ab-31f8fa185db4", "content-length": "585", "date": "Wed, 18 Jun 2025 18:47:47 GMT"} })
30272025-06-18T18:47:48.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30282025-06-18T18:47:48.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30292025-06-18T18:47:48.019ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30302025-06-18T18:47:48.019ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30312025-06-18T18:47:48.020ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30322025-06-18T18:47:48.023ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30332025-06-18T18:47:48.023ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30342025-06-18T18:47:48.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
30352025-06-18T18:47:48.023ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30362025-06-18T18:47:48.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30372025-06-18T18:47:48.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30382025-06-18T18:47:48.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
30392025-06-18T18:47:48.023ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30402025-06-18T18:47:48.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30412025-06-18T18:47:48.025ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 72dd4529-6655-4d30-a1d8-0de429d0133c dns_zone_name = oxide.test found_so_far = 4 version = 2
30422025-06-18T18:47:48.025ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
30432025-06-18T18:47:48.025ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-18 18:36:20.010620 UTC dns_group = external generation = 2
30442025-06-18T18:47:48.025ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 467.264657ms iteration = 13 status = {"generation":2}
30452025-06-18T18:47:48.026ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = ab8dd933-5e45-404d-97a3-fdafa1c7d91b dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
30462025-06-18T18:47:48.026ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
30472025-06-18T18:47:48.026ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-18 18:36:19.303122 UTC dns_group = internal generation = 1
30482025-06-18T18:47:48.026ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 467.217675ms iteration = 13 status = {"generation":1}
30492025-06-18T18:47:48.029ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
30502025-06-18T18:47:48.029ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 470.511842ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
30512025-06-18T18:47:48.057ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30522025-06-18T18:47:48.060ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30532025-06-18T18:47:48.060ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30542025-06-18T18:47:48.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30552025-06-18T18:47:48.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30562025-06-18T18:47:48.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30572025-06-18T18:47:48.063ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 7e1ff921-047f-464e-8081-f8132af716ac, rack_id: 3a330d2e-6212-46a4-9781-374fdb3dc92f, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(6c07c314-d66b-4041-9040-d774200d26a9) } rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
30582025-06-18T18:47:48.063ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30592025-06-18T18:47:48.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30602025-06-18T18:47:48.065ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {743c4160-122a-4aad-9b1f-a0c4f965f3d6: {10.151.1.175: {37698d5d-9fd9-40ea-ae57-b0f8627bc1cd}, 10.151.1.176: {37698d5d-9fd9-40ea-ae57-b0f8627bc1cd}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
30612025-06-18T18:47:48.065ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
30622025-06-18T18:47:48.065ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ba6b0216-e7b2-4bf4-8eab-97bc7be8ac94", "date": "Wed, 18 Jun 2025 18:47:47 GMT"} })
30632025-06-18T18:47:48.065ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30642025-06-18T18:47:48.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30652025-06-18T18:47:48.092ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
30662025-06-18T18:47:48.092ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "39b4efea-7c75-4e24-82d6-a634550bbd1c", "content-length": "811", "date": "Wed, 18 Jun 2025 18:47:47 GMT"} })
30672025-06-18T18:47:48.092ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(15085319) }} sled = buskin
30682025-06-18T18:47:48.092ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
30692025-06-18T18:47:48.092ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
30702025-06-18T18:47:48.094ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 534.665376ms iteration = 25 status = {}
30712025-06-18T18:47:48.094ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30722025-06-18T18:47:48.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30732025-06-18T18:47:48.097ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30742025-06-18T18:47:48.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30752025-06-18T18:47:48.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30762025-06-18T18:47:48.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30772025-06-18T18:47:48.102ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30782025-06-18T18:47:48.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30792025-06-18T18:47:48.104ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
30802025-06-18T18:47:48.104ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 6c07c314-d66b-4041-9040-d774200d26a9
30812025-06-18T18:47:48.104ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
30822025-06-18T18:47:48.104ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
30832025-06-18T18:47:48.104ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30842025-06-18T18:47:48.104ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30852025-06-18T18:47:48.104ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30862025-06-18T18:47:48.104ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30872025-06-18T18:47:48.104ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30882025-06-18T18:47:48.104ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30892025-06-18T18:47:48.104ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
30902025-06-18T18:47:48.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30912025-06-18T18:47:48.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30922025-06-18T18:47:48.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30932025-06-18T18:47:48.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30942025-06-18T18:47:48.107ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
30952025-06-18T18:47:48.107ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
30962025-06-18T18:47:48.108ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
30972025-06-18T18:47:48.108ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
30982025-06-18T18:47:48.108ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30992025-06-18T18:47:48.214ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7b8b2297-1bb7-4289-92b2-0ecb5758fec9", "date": "Wed, 18 Jun 2025 18:47:47 GMT"} })
31002025-06-18T18:47:48.214ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch = Switch0
31012025-06-18T18:47:48.214ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
31022025-06-18T18:47:48.214ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8ae6d030-a370-45f0-836e-e4ba3c402ab0", "date": "Wed, 18 Jun 2025 18:47:47 GMT"} })
31032025-06-18T18:47:48.215ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 656.243013ms iteration = 25 status = {}
31042025-06-18T18:47:48.216ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ee53c02-55b1-45e7-8ce0-00af0ed8f38f", "content-length": "682", "date": "Wed, 18 Jun 2025 18:47:47 GMT"} })
31052025-06-18T18:47:48.216ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31062025-06-18T18:47:48.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31072025-06-18T18:47:48.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31082025-06-18T18:47:48.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31092025-06-18T18:47:48.224ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31102025-06-18T18:47:48.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31112025-06-18T18:47:48.226ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31122025-06-18T18:47:48.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31132025-06-18T18:47:48.234ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 675.345187ms iteration = 25 status = {}
31142025-06-18T18:47:48.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5ddbea9f-d6e5-4250-ae70-f8246e13aed6 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
31152025-06-18T18:47:48.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5ddbea9f-d6e5-4250-ae70-f8246e13aed6 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
31162025-06-18T18:47:48.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 9661 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5ddbea9f-d6e5-4250-ae70-f8246e13aed6 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
31172025-06-18T18:47:49.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3a0f02e4-cdb0-4adf-add9-c25c4de6632e roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
31182025-06-18T18:47:49.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3a0f02e4-cdb0-4adf-add9-c25c4de6632e resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
31192025-06-18T18:47:49.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2494 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3a0f02e4-cdb0-4adf-add9-c25c4de6632e response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
31202025-06-18T18:47:49.766ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 76d75268-c3fa-41e3-936e-d2506da5c6a4 remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 71c939a8-9161-4e10-8ba1-8bfa2689c0c4 uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-06-18T18:47:49.766324789Z }
31212025-06-18T18:47:49.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 71c939a8-9161-4e10-8ba1-8bfa2689c0c4 roles = RoleSet { roles: {} } uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
31222025-06-18T18:47:49.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 71c939a8-9161-4e10-8ba1-8bfa2689c0c4 resource = Database result = Ok(()) uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
31232025-06-18T18:47:49.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 50254 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 71c939a8-9161-4e10-8ba1-8bfa2689c0c4 response_code = 204 uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
31242025-06-18T18:47:50.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a901ce6f-b7b4-4306-9965-8362a004bdf2 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
31252025-06-18T18:47:50.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a901ce6f-b7b4-4306-9965-8362a004bdf2 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
31262025-06-18T18:47:50.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2708 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a901ce6f-b7b4-4306-9965-8362a004bdf2 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
31272025-06-18T18:47:51.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39667 req_id = 6c05030a-667c-480e-a19b-43417950751b roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
31282025-06-18T18:47:51.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39667 req_id = 6c05030a-667c-480e-a19b-43417950751b resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
31292025-06-18T18:47:51.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3725 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39667 req_id = 6c05030a-667c-480e-a19b-43417950751b response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
31302025-06-18T18:47:51.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39667 req_id = 6299047d-135a-4134-8102-0e0b84c8072d roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
31312025-06-18T18:47:51.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39667 req_id = 6299047d-135a-4134-8102-0e0b84c8072d resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
31322025-06-18T18:47:51.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2759 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39667 req_id = 6299047d-135a-4134-8102-0e0b84c8072d response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
31332025-06-18T18:47:51.133ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 617 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 828ba01e-d8e4-4bff-8fa6-ffb60c167fd3 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
31342025-06-18T18:47:51.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b537151d-b718-4452-a49d-522699520fff roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
31352025-06-18T18:47:51.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b537151d-b718-4452-a49d-522699520fff resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
31362025-06-18T18:47:51.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2112 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b537151d-b718-4452-a49d-522699520fff response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
31372025-06-18T18:47:52.222ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 76d75268-c3fa-41e3-936e-d2506da5c6a4 remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0c495f10-5d1c-49fc-8a46-5c524ff27476 uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-06-18T18:47:49.817037517Z }
31382025-06-18T18:47:52.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0c495f10-5d1c-49fc-8a46-5c524ff27476 roles = RoleSet { roles: {} } uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
31392025-06-18T18:47:52.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0c495f10-5d1c-49fc-8a46-5c524ff27476 resource = Database result = Ok(()) uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
31402025-06-18T18:47:52.233ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 76d75268-c3fa-41e3-936e-d2506da5c6a4 remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0c495f10-5d1c-49fc-8a46-5c524ff27476 uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4 vmm_needs_update = true
31412025-06-18T18:47:52.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0c495f10-5d1c-49fc-8a46-5c524ff27476 roles = RoleSet { roles: {} } uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
31422025-06-18T18:47:52.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0c495f10-5d1c-49fc-8a46-5c524ff27476 resource = Database result = Ok(()) uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
31432025-06-18T18:47:52.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0c495f10-5d1c-49fc-8a46-5c524ff27476 roles = RoleSet { roles: {} } uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
31442025-06-18T18:47:52.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0c495f10-5d1c-49fc-8a46-5c524ff27476 resource = Database result = Ok(()) uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
31452025-06-18T18:47:52.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0c495f10-5d1c-49fc-8a46-5c524ff27476 roles = RoleSet { roles: {} } uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
31462025-06-18T18:47:52.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0c495f10-5d1c-49fc-8a46-5c524ff27476 resource = Database result = Ok(()) uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
31472025-06-18T18:47:52.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0c495f10-5d1c-49fc-8a46-5c524ff27476 roles = RoleSet { roles: {} } uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
31482025-06-18T18:47:52.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0c495f10-5d1c-49fc-8a46-5c524ff27476 resource = Database result = Ok(()) uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
31492025-06-18T18:47:52.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0c495f10-5d1c-49fc-8a46-5c524ff27476 roles = RoleSet { roles: {} } uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
31502025-06-18T18:47:52.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0c495f10-5d1c-49fc-8a46-5c524ff27476 resource = Database result = Ok(()) uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
31512025-06-18T18:47:52.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0c495f10-5d1c-49fc-8a46-5c524ff27476 roles = RoleSet { roles: {} } uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
31522025-06-18T18:47:52.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0c495f10-5d1c-49fc-8a46-5c524ff27476 resource = Database result = Ok(()) uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
31532025-06-18T18:47:52.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0c495f10-5d1c-49fc-8a46-5c524ff27476 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
31542025-06-18T18:47:52.254ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0c495f10-5d1c-49fc-8a46-5c524ff27476 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 472c0288-095b-456c-b18f-d5f22a8efd72, lookup_type: ById(472c0288-095b-456c-b18f-d5f22a8efd72) }, key: a8c4b94d-92e3-44b4-9528-ddd8e733a650, lookup_type: ById(a8c4b94d-92e3-44b4-9528-ddd8e733a650) }, key: 16304ac0-83c7-45a6-96f5-46892e20fa17, lookup_type: ById(16304ac0-83c7-45a6-96f5-46892e20fa17) } result = Ok(()) uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
31552025-06-18T18:47:52.268ZINFOnexus (dropshot_internal): starting update saga for 16304ac0-83c7-45a6-96f5-46892e20fa17 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1603 instance_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0c495f10-5d1c-49fc-8a46-5c524ff27476 uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-06-18T18:47:49.817037517Z }
31562025-06-18T18:47:52.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 46166 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0c495f10-5d1c-49fc-8a46-5c524ff27476 response_code = 204 uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
31572025-06-18T18:47:52.270ZDEBGnexus (dropshot_internal): preparing instance-update saga for 16304ac0-83c7-45a6-96f5-46892e20fa17... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0c495f10-5d1c-49fc-8a46-5c524ff27476 uri = /vmms/76d75268-c3fa-41e3-936e-d2506da5c6a4
31582025-06-18T18:47:52.270ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update
31592025-06-18T18:47:52.270ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"16304ac0-83c7-45a6-96f5-46892e20fa17","lookup_type":{"ById":"16304ac0-83c7-45a6-96f5-46892e20fa17"},"parent":{"key":"a8c4b94d-92e3-44b4-9528-ddd8e733a650","lookup_type":{"ById":"a8c4b94d-92e3-44b4-9528-ddd8e733a650"},"parent":{"key":"472c0288-095b-456c-b18f-d5f22a8efd72","lookup_type":{"ById":"472c0288-095b-456c-b18f-d5f22a8efd72"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
31602025-06-18T18:47:52.273ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update
31612025-06-18T18:47:52.321ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update
31622025-06-18T18:47:52.321ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
31632025-06-18T18:47:52.323ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
31642025-06-18T18:47:52.323ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 395d35a3-307f-4164-93b9-e6607051a966
31652025-06-18T18:47:52.330ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
31662025-06-18T18:47:52.330ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 395d35a3-307f-4164-93b9-e6607051a966
31672025-06-18T18:47:52.336ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
31682025-06-18T18:47:52.336ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 395d35a3-307f-4164-93b9-e6607051a966
31692025-06-18T18:47:52.342ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
31702025-06-18T18:47:52.342ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("01e8079d-ccc7-4120-8dd8-770506586d1b")) node_id = 0 saga_id = 395d35a3-307f-4164-93b9-e6607051a966
31712025-06-18T18:47:52.345ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
31722025-06-18T18:47:52.345ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 395d35a3-307f-4164-93b9-e6607051a966
31732025-06-18T18:47:52.361ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update
31742025-06-18T18:47:52.361ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = LockInstance
31752025-06-18T18:47:52.362ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = LockInstance
31762025-06-18T18:47:52.364ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = LockInstance
31772025-06-18T18:47:52.364ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = LockInstance
31782025-06-18T18:47:52.365ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = LockInstance
31792025-06-18T18:47:52.366ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = LockInstance
31802025-06-18T18:47:52.367ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = LockInstance
31812025-06-18T18:47:52.368ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = LockInstance
31822025-06-18T18:47:52.369ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = LockInstance
31832025-06-18T18:47:52.369ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = LockInstance
31842025-06-18T18:47:52.370ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = LockInstance
31852025-06-18T18:47:52.371ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = LockInstance
31862025-06-18T18:47:52.372ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = LockInstance
31872025-06-18T18:47:52.375ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 472c0288-095b-456c-b18f-d5f22a8efd72, lookup_type: ById(472c0288-095b-456c-b18f-d5f22a8efd72) }, key: a8c4b94d-92e3-44b4-9528-ddd8e733a650, lookup_type: ById(a8c4b94d-92e3-44b4-9528-ddd8e733a650) }, key: 16304ac0-83c7-45a6-96f5-46892e20fa17, lookup_type: ById(16304ac0-83c7-45a6-96f5-46892e20fa17) } result = Ok(()) saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = LockInstance
31882025-06-18T18:47:52.375ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = LockInstance updater_id = 01e8079d-ccc7-4120-8dd8-770506586d1b
31892025-06-18T18:47:52.375ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = LockInstance
31902025-06-18T18:47:52.375ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = LockInstance
31912025-06-18T18:47:52.394ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = LockInstance updater_id = 01e8079d-ccc7-4120-8dd8-770506586d1b
31922025-06-18T18:47:52.394ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = LockInstance
31932025-06-18T18:47:52.394ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = LockInstance
31942025-06-18T18:47:52.402ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 locked_gen = Generation(Generation(2)) saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = LockInstance updater_id = 01e8079d-ccc7-4120-8dd8-770506586d1b
31952025-06-18T18:47:52.404ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
31962025-06-18T18:47:52.404ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("01e8079d-ccc7-4120-8dd8-770506586d1b")}) node_id = 1 saga_id = 395d35a3-307f-4164-93b9-e6607051a966
31972025-06-18T18:47:52.408ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
31982025-06-18T18:47:52.408ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 395d35a3-307f-4164-93b9-e6607051a966
31992025-06-18T18:47:52.418ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
32002025-06-18T18:47:52.418ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
32012025-06-18T18:47:52.424ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
32022025-06-18T18:47:52.424ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
32032025-06-18T18:47:52.426ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
32042025-06-18T18:47:52.426ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
32052025-06-18T18:47:52.427ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
32062025-06-18T18:47:52.431ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 472c0288-095b-456c-b18f-d5f22a8efd72, lookup_type: ById(472c0288-095b-456c-b18f-d5f22a8efd72) }, key: a8c4b94d-92e3-44b4-9528-ddd8e733a650, lookup_type: ById(a8c4b94d-92e3-44b4-9528-ddd8e733a650) }, key: 16304ac0-83c7-45a6-96f5-46892e20fa17, lookup_type: ById(16304ac0-83c7-45a6-96f5-46892e20fa17) } result = Ok(()) saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
32072025-06-18T18:47:52.431ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
32082025-06-18T18:47:52.431ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
32092025-06-18T18:47:52.443ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 76d75268-c3fa-41e3-936e-d2506da5c6a4, time_created: 2025-06-18T18:47:31.141206Z, time_deleted: None, instance_id: 16304ac0-83c7-45a6-96f5-46892e20fa17, sled_id: 9fbbc826-5b83-4b80-8172-66302c618aae, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-06-18T18:47:49.817037Z, gen: Generation(Generation(7)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-06-18T18:47:28.859965Z, gen: Generation(Generation(3)), propolis_id: Some(76d75268-c3fa-41e3-936e-d2506da5c6a4), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(76d75268-c3fa-41e3-936e-d2506da5c6a4 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-06-18T18:47:52.443508162Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
32102025-06-18T18:47:52.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c38df1d1-e810-45c3-bc29-e385a817b9c1 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
32112025-06-18T18:47:52.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c38df1d1-e810-45c3-bc29-e385a817b9c1 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
32122025-06-18T18:47:52.446ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update
32132025-06-18T18:47:52.446ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"16304ac0-83c7-45a6-96f5-46892e20fa17","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"76d75268-c3fa-41e3-936e-d2506da5c6a4"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"16304ac0-83c7-45a6-96f5-46892e20fa17","lookup_type":{"ById":"16304ac0-83c7-45a6-96f5-46892e20fa17"},"parent":{"key":"a8c4b94d-92e3-44b4-9528-ddd8e733a650","lookup_type":{"ById":"a8c4b94d-92e3-44b4-9528-ddd8e733a650"},"parent":{"key":"472c0288-095b-456c-b18f-d5f22a8efd72","lookup_type":{"ById":"472c0288-095b-456c-b18f-d5f22a8efd72"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"01e8079d-ccc7-4120-8dd8-770506586d1b"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"a8c4b94d-92e3-44b4-9528-ddd8e733a650","ram_diff":1073741824},"destroy_active_vmm":"76d75268-c3fa-41e3-936e-d2506da5c6a4","destroy_target_vmm":null,"network_config":"Delete","new_intent":null,"new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-06-18T18:47:52.443508162Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
32142025-06-18T18:47:52.446ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update
32152025-06-18T18:47:52.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2623 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c38df1d1-e810-45c3-bc29-e385a817b9c1 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
32162025-06-18T18:47:52.487ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update
32172025-06-18T18:47:52.487ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
32182025-06-18T18:47:52.487ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
32192025-06-18T18:47:52.487ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
32202025-06-18T18:47:52.492ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
32212025-06-18T18:47:52.492ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
32222025-06-18T18:47:52.496ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
32232025-06-18T18:47:52.496ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
32242025-06-18T18:47:52.500ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
32252025-06-18T18:47:52.500ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("bab6c2d0-73c7-46e6-a429-bf2c3dbe7bbd")) node_id = 0 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
32262025-06-18T18:47:52.504ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
32272025-06-18T18:47:52.504ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
32282025-06-18T18:47:52.511ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 parent_lock = UpdaterLock { updater_id: 01e8079d-ccc7-4120-8dd8-770506586d1b, locked_gen: Generation(Generation(2)) } saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update
32292025-06-18T18:47:52.511ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = BecomeUpdater
32302025-06-18T18:47:52.511ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = BecomeUpdater
32312025-06-18T18:47:52.528ZDEBGnexus (SagaExecutor): inherited lock from 01e8079d-ccc7-4120-8dd8-770506586d1b to bab6c2d0-73c7-46e6-a429-bf2c3dbe7bbd actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 01e8079d-ccc7-4120-8dd8-770506586d1b saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = BecomeUpdater updater_id = bab6c2d0-73c7-46e6-a429-bf2c3dbe7bbd
32322025-06-18T18:47:52.528ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:987 instance_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update
32332025-06-18T18:47:52.528ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
32342025-06-18T18:47:52.528ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("bab6c2d0-73c7-46e6-a429-bf2c3dbe7bbd")}) node_id = 1 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
32352025-06-18T18:47:52.531ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
32362025-06-18T18:47:52.532ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
32372025-06-18T18:47:52.535ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
32382025-06-18T18:47:52.535ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
32392025-06-18T18:47:52.539ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
32402025-06-18T18:47:52.539ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
32412025-06-18T18:47:52.544ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1040 instance_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update
32422025-06-18T18:47:52.544ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 16304ac0-83c7-45a6-96f5-46892e20fa17
32432025-06-18T18:47:52.546ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = UpdateNetworkConfig
32442025-06-18T18:47:52.547ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = UpdateNetworkConfig
32452025-06-18T18:47:52.552ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = UpdateNetworkConfig
32462025-06-18T18:47:52.553ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = UpdateNetworkConfig
32472025-06-18T18:47:52.558ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
32482025-06-18T18:47:52.558ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = UpdateNetworkConfig
32492025-06-18T18:47:52.558ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = UpdateNetworkConfig
32502025-06-18T18:47:52.560ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
32512025-06-18T18:47:52.560ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
32522025-06-18T18:47:52.560ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
32532025-06-18T18:47:52.562ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
32542025-06-18T18:47:52.564ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
32552025-06-18T18:47:52.564ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
32562025-06-18T18:47:52.564ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
32572025-06-18T18:47:52.572ZDEBGnexus: notifying dendrite of updates instance_id = Some(16304ac0-83c7-45a6-96f5-46892e20fa17 (instance)) switch = switch0
32582025-06-18T18:47:52.573ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1662, tv_nsec: 153151210 } })
32592025-06-18T18:47:52.573ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1179
32602025-06-18T18:47:52.604ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
32612025-06-18T18:47:52.604ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
32622025-06-18T18:47:52.604ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "27600413-1b14-45e0-a579-92df26190c8d", "content-length": "26", "date": "Wed, 18 Jun 2025 18:47:52 GMT"} })
32632025-06-18T18:47:52.604ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
32642025-06-18T18:47:52.604ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
32652025-06-18T18:47:52.635ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
32662025-06-18T18:47:52.635ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
32672025-06-18T18:47:52.640ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
32682025-06-18T18:47:52.640ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
32692025-06-18T18:47:52.648ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = ReleaseVirtualProvisioning
32702025-06-18T18:47:52.648ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = ReleaseVirtualProvisioning
32712025-06-18T18:47:52.663ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1115 instance_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-06-18T18:47:52.651655Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 472c0288-095b-456c-b18f-d5f22a8efd72, time_modified: Some(2025-06-18T18:47:52.651655Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: a8c4b94d-92e3-44b4-9528-ddd8e733a650, time_modified: Some(2025-06-18T18:47:52.651655Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update
32722025-06-18T18:47:52.663ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
32732025-06-18T18:47:52.663ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
32742025-06-18T18:47:52.667ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
32752025-06-18T18:47:52.667ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
32762025-06-18T18:47:52.680ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1150 instance_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update
32772025-06-18T18:47:52.680ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = UnassignOximeterProducer
32782025-06-18T18:47:52.681ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = UnassignOximeterProducer
32792025-06-18T18:47:52.689ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = c88bda47-97a6-468e-bf39-3fffe994d639 producer_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update
32802025-06-18T18:47:52.689ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = UnassignOximeterProducer
32812025-06-18T18:47:52.689ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = UnassignOximeterProducer
32822025-06-18T18:47:52.724ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 16304ac0-83c7-45a6-96f5-46892e20fa17 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update
32832025-06-18T18:47:52.724ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 16304ac0-83c7-45a6-96f5-46892e20fa17 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/16304ac0-83c7-45a6-96f5-46892e20fa17
32842025-06-18T18:47:52.743ZDEBGnexus (SagaExecutor): client response oximeter-collector = 16304ac0-83c7-45a6-96f5-46892e20fa17 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/16304ac0-83c7-45a6-96f5-46892e20fa17", status: 204, headers: {"x-request-id": "4dfb2871-a22c-41e5-b3b6-22b4ef8f6859", "date": "Wed, 18 Jun 2025 18:47:52 GMT"} }) saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update
32852025-06-18T18:47:52.743ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = c88bda47-97a6-468e-bf39-3fffe994d639 producer_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update
32862025-06-18T18:47:52.745ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
32872025-06-18T18:47:52.745ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
32882025-06-18T18:47:52.749ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
32892025-06-18T18:47:52.749ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
32902025-06-18T18:47:52.756ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 lock = UpdaterLock { updater_id: bab6c2d0-73c7-46e6-a429-bf2c3dbe7bbd, locked_gen: Generation(Generation(3)) } new_intent = None new_runtime = InstanceRuntimeState { time_updated: 2025-06-18T18:47:52.443508162Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update
32912025-06-18T18:47:52.756ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = CommitInstanceUpdates
32922025-06-18T18:47:52.756ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = CommitInstanceUpdates
32932025-06-18T18:47:52.782ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1201 instance_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 new_runtime = InstanceRuntimeState { time_updated: 2025-06-18T18:47:52.443508162Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update
32942025-06-18T18:47:52.783ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
32952025-06-18T18:47:52.783ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
32962025-06-18T18:47:52.783ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
32972025-06-18T18:47:52.783ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Signaled
32982025-06-18T18:47:52.783ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
32992025-06-18T18:47:52.783ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33002025-06-18T18:47:52.783ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33012025-06-18T18:47:52.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33022025-06-18T18:47:52.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33032025-06-18T18:47:52.785ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33042025-06-18T18:47:52.787ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33052025-06-18T18:47:52.787ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33062025-06-18T18:47:52.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33072025-06-18T18:47:52.789ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33082025-06-18T18:47:52.791ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33092025-06-18T18:47:52.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33102025-06-18T18:47:52.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33112025-06-18T18:47:52.793ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33122025-06-18T18:47:52.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33132025-06-18T18:47:52.794ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
33142025-06-18T18:47:52.794ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
33152025-06-18T18:47:52.798ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
33162025-06-18T18:47:52.798ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("16304ac0-83c7-45a6-96f5-46892e20fa17"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("76d75268-c3fa-41e3-936e-d2506da5c6a4")}) node_id = 7 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
33172025-06-18T18:47:52.803ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
33182025-06-18T18:47:52.803ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
33192025-06-18T18:47:52.807ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
33202025-06-18T18:47:52.807ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
33212025-06-18T18:47:52.824ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
33222025-06-18T18:47:52.824ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33232025-06-18T18:47:52.825ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2cc0695f-f0a7-42d4-a2ce-41766e854440", "content-length": "372", "date": "Wed, 18 Jun 2025 18:47:52 GMT"} })
33242025-06-18T18:47:52.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33252025-06-18T18:47:52.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33262025-06-18T18:47:52.828ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
33272025-06-18T18:47:52.828ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
33282025-06-18T18:47:52.835ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:82 instance_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 propolis_id = 76d75268-c3fa-41e3-936e-d2506da5c6a4 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update
33292025-06-18T18:47:52.835ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = ReleaseSledResources
33302025-06-18T18:47:52.836ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = ReleaseSledResources
33312025-06-18T18:47:52.847ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {743c4160-122a-4aad-9b1f-a0c4f965f3d6: {10.151.1.176: {37698d5d-9fd9-40ea-ae57-b0f8627bc1cd}, 10.151.1.175: {37698d5d-9fd9-40ea-ae57-b0f8627bc1cd}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
33322025-06-18T18:47:52.847ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
33332025-06-18T18:47:52.847ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "60b0f743-1dd2-4569-86f8-c89a59c348c3", "date": "Wed, 18 Jun 2025 18:47:52 GMT"} })
33342025-06-18T18:47:52.847ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33352025-06-18T18:47:52.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33362025-06-18T18:47:52.849ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33372025-06-18T18:47:52.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33382025-06-18T18:47:52.850ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
33392025-06-18T18:47:52.850ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
33402025-06-18T18:47:52.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33412025-06-18T18:47:52.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33422025-06-18T18:47:52.853ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
33432025-06-18T18:47:52.853ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
33442025-06-18T18:47:52.856ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
33452025-06-18T18:47:52.856ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
33462025-06-18T18:47:52.856ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bda7f3c0-49f9-4ede-b471-ef8eee48f4e2", "date": "Wed, 18 Jun 2025 18:47:52 GMT"} })
33472025-06-18T18:47:52.857ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:113 instance_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 propolis_id = 76d75268-c3fa-41e3-936e-d2506da5c6a4 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update
33482025-06-18T18:47:52.857ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = MarkVmmDeleted
33492025-06-18T18:47:52.857ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = MarkVmmDeleted
33502025-06-18T18:47:52.858ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 75.639093ms iteration = 26 status = {}
33512025-06-18T18:47:52.903ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
33522025-06-18T18:47:52.903ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
33532025-06-18T18:47:52.907ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
33542025-06-18T18:47:52.907ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
33552025-06-18T18:47:52.907ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33562025-06-18T18:47:52.907ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33572025-06-18T18:47:52.908ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33582025-06-18T18:47:52.910ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
33592025-06-18T18:47:52.910ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
33602025-06-18T18:47:52.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33612025-06-18T18:47:52.910ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33622025-06-18T18:47:52.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33632025-06-18T18:47:52.912ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33642025-06-18T18:47:52.913ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
33652025-06-18T18:47:52.913ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
33662025-06-18T18:47:52.914ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33672025-06-18T18:47:52.914ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33682025-06-18T18:47:52.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33692025-06-18T18:47:52.916ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = ChainSuccessorSaga
33702025-06-18T18:47:52.916ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = ChainSuccessorSaga
33712025-06-18T18:47:52.918ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = ChainSuccessorSaga
33722025-06-18T18:47:52.918ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = ChainSuccessorSaga
33732025-06-18T18:47:52.919ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = ChainSuccessorSaga
33742025-06-18T18:47:52.919ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = ChainSuccessorSaga
33752025-06-18T18:47:52.921ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = ChainSuccessorSaga
33762025-06-18T18:47:52.924ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 472c0288-095b-456c-b18f-d5f22a8efd72, lookup_type: ById(472c0288-095b-456c-b18f-d5f22a8efd72) }, key: a8c4b94d-92e3-44b4-9528-ddd8e733a650, lookup_type: ById(a8c4b94d-92e3-44b4-9528-ddd8e733a650) }, key: 16304ac0-83c7-45a6-96f5-46892e20fa17, lookup_type: ById(16304ac0-83c7-45a6-96f5-46892e20fa17) } result = Ok(()) saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = ChainSuccessorSaga
33772025-06-18T18:47:52.924ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = ChainSuccessorSaga
33782025-06-18T18:47:52.924ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_node = ChainSuccessorSaga
33792025-06-18T18:47:52.996ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1351 instance_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update
33802025-06-18T18:47:52.998ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
33812025-06-18T18:47:52.998ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
33822025-06-18T18:47:52.998ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Signaled
33832025-06-18T18:47:52.998ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
33842025-06-18T18:47:52.998ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33852025-06-18T18:47:52.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33862025-06-18T18:47:53.007ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
33872025-06-18T18:47:53.008ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1674e1b-9b89-47eb-9976-5a49d09fe5f6", "content-length": "691", "date": "Wed, 18 Jun 2025 18:47:52 GMT"} })
33882025-06-18T18:47:53.008ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
33892025-06-18T18:47:53.008ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
33902025-06-18T18:47:53.008ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
33912025-06-18T18:47:53.010ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 227.697202ms iteration = 26 status = {}
33922025-06-18T18:47:53.010ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33932025-06-18T18:47:53.010ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
33942025-06-18T18:47:53.010ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33952025-06-18T18:47:53.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33962025-06-18T18:47:53.011ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
33972025-06-18T18:47:53.011ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
33982025-06-18T18:47:53.013ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33992025-06-18T18:47:53.013ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
34002025-06-18T18:47:53.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34012025-06-18T18:47:53.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34022025-06-18T18:47:53.015ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
34032025-06-18T18:47:53.015ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
34042025-06-18T18:47:53.016ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34052025-06-18T18:47:53.016ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
34062025-06-18T18:47:53.016ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 17.241808ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
34072025-06-18T18:47:53.019ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
34082025-06-18T18:47:53.019ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d
34092025-06-18T18:47:53.062ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
34102025-06-18T18:47:53.062ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d saga_name = instance-update saga_result = SagaResult { saga_id: 0b78a2ea-3e0e-474e-abc2-6575bccade6d, saga_log: SagaLog { saga_id: 0b78a2ea-3e0e-474e-abc2-6575bccade6d, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("bab6c2d0-73c7-46e6-a429-bf2c3dbe7bbd")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("bab6c2d0-73c7-46e6-a429-bf2c3dbe7bbd")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("16304ac0-83c7-45a6-96f5-46892e20fa17"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("76d75268-c3fa-41e3-936e-d2506da5c6a4")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("16304ac0-83c7-45a6-96f5-46892e20fa17"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("76d75268-c3fa-41e3-936e-d2506da5c6a4")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("bab6c2d0-73c7-46e6-a429-bf2c3dbe7bbd"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("bab6c2d0-73c7-46e6-a429-bf2c3dbe7bbd")}} }) }
34112025-06-18T18:47:53.062ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 0b78a2ea-3e0e-474e-abc2-6575bccade6d instance_id = 16304ac0-83c7-45a6-96f5-46892e20fa17 saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update
34122025-06-18T18:47:53.062ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
34132025-06-18T18:47:53.062ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 395d35a3-307f-4164-93b9-e6607051a966
34142025-06-18T18:47:53.065ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
34152025-06-18T18:47:53.065ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 395d35a3-307f-4164-93b9-e6607051a966
34162025-06-18T18:47:53.069ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
34172025-06-18T18:47:53.069ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 395d35a3-307f-4164-93b9-e6607051a966
34182025-06-18T18:47:53.074ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 395d35a3-307f-4164-93b9-e6607051a966 sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
34192025-06-18T18:47:53.074ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 395d35a3-307f-4164-93b9-e6607051a966
34202025-06-18T18:47:53.131ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update sec_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
34212025-06-18T18:47:53.131ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 395d35a3-307f-4164-93b9-e6607051a966 saga_name = start-instance-update saga_result = SagaResult { saga_id: 395d35a3-307f-4164-93b9-e6607051a966, saga_log: SagaLog { saga_id: 395d35a3-307f-4164-93b9-e6607051a966, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("01e8079d-ccc7-4120-8dd8-770506586d1b")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("01e8079d-ccc7-4120-8dd8-770506586d1b")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("01e8079d-ccc7-4120-8dd8-770506586d1b"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("01e8079d-ccc7-4120-8dd8-770506586d1b")}} }) }
34222025-06-18T18:47:53.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 03dd8fb8-3691-4d4d-a7ec-7ff7be5085e3 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34232025-06-18T18:47:53.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 03dd8fb8-3691-4d4d-a7ec-7ff7be5085e3 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34242025-06-18T18:47:53.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2330 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 03dd8fb8-3691-4d4d-a7ec-7ff7be5085e3 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34252025-06-18T18:47:54.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = da6afe81-6240-4f0e-8759-e8f894d05b3d roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34262025-06-18T18:47:54.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = da6afe81-6240-4f0e-8759-e8f894d05b3d resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34272025-06-18T18:47:54.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2314 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = da6afe81-6240-4f0e-8759-e8f894d05b3d response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34282025-06-18T18:47:55.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0b8c9e6c-0ba4-468b-988b-6358640e8509 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34292025-06-18T18:47:55.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0b8c9e6c-0ba4-468b-988b-6358640e8509 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34302025-06-18T18:47:55.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2649 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0b8c9e6c-0ba4-468b-988b-6358640e8509 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34312025-06-18T18:47:56.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0483a5a2-ae14-4988-8b59-9bb8d039b01c roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34322025-06-18T18:47:56.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0483a5a2-ae14-4988-8b59-9bb8d039b01c resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34332025-06-18T18:47:56.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2164 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0483a5a2-ae14-4988-8b59-9bb8d039b01c response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34342025-06-18T18:47:57.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 03b5e126-331d-4788-af73-efa5ca0b980a roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34352025-06-18T18:47:57.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 03b5e126-331d-4788-af73-efa5ca0b980a resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34362025-06-18T18:47:57.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2730 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 03b5e126-331d-4788-af73-efa5ca0b980a response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34372025-06-18T18:47:57.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
34382025-06-18T18:47:57.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
34392025-06-18T18:47:57.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34402025-06-18T18:47:57.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34412025-06-18T18:47:57.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34422025-06-18T18:47:57.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34432025-06-18T18:47:57.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34442025-06-18T18:47:57.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34452025-06-18T18:47:57.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34462025-06-18T18:47:57.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34472025-06-18T18:47:57.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34482025-06-18T18:47:57.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34492025-06-18T18:47:57.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34502025-06-18T18:47:57.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
34512025-06-18T18:47:57.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34522025-06-18T18:47:57.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34532025-06-18T18:47:57.582ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
34542025-06-18T18:47:57.582ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.725788ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
34552025-06-18T18:47:57.591ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34562025-06-18T18:47:57.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34572025-06-18T18:47:57.631ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.989427ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34582025-06-18T18:47:58.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 93ae3951-3d6d-49fe-be99-f1d2d3ca2340 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34592025-06-18T18:47:58.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 93ae3951-3d6d-49fe-be99-f1d2d3ca2340 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34602025-06-18T18:47:58.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2188 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 93ae3951-3d6d-49fe-be99-f1d2d3ca2340 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34612025-06-18T18:47:59.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 75790ba0-565f-4dd0-ba19-abd016c25629 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34622025-06-18T18:47:59.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 75790ba0-565f-4dd0-ba19-abd016c25629 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34632025-06-18T18:47:59.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2872 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 75790ba0-565f-4dd0-ba19-abd016c25629 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34642025-06-18T18:48:00.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b1575a86-47ea-4e9b-8c75-b6e85860c71e roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34652025-06-18T18:48:00.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b1575a86-47ea-4e9b-8c75-b6e85860c71e resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34662025-06-18T18:48:00.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1806 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b1575a86-47ea-4e9b-8c75-b6e85860c71e response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34672025-06-18T18:48:01.133ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 898 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 04a9efea-910e-4e00-8c46-daf021d93c55 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
34682025-06-18T18:48:01.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a2bdd448-a0a8-47e9-a633-889e908de028 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34692025-06-18T18:48:01.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a2bdd448-a0a8-47e9-a633-889e908de028 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34702025-06-18T18:48:01.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2424 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a2bdd448-a0a8-47e9-a633-889e908de028 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34712025-06-18T18:48:02.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 781434af-8332-4c86-8a58-c7a6661fc3bc roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34722025-06-18T18:48:02.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 781434af-8332-4c86-8a58-c7a6661fc3bc resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34732025-06-18T18:48:02.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2507 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 781434af-8332-4c86-8a58-c7a6661fc3bc response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34742025-06-18T18:48:03.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0737c0c4-65de-4a24-b912-e589023647d6 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34752025-06-18T18:48:03.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0737c0c4-65de-4a24-b912-e589023647d6 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34762025-06-18T18:48:03.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2620 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0737c0c4-65de-4a24-b912-e589023647d6 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34772025-06-18T18:48:04.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ccd17e7a-85b5-4a3e-9c21-93f917da514f roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34782025-06-18T18:48:04.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ccd17e7a-85b5-4a3e-9c21-93f917da514f resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34792025-06-18T18:48:04.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2409 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ccd17e7a-85b5-4a3e-9c21-93f917da514f response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34802025-06-18T18:48:05.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7b5a5160-b25b-44ce-8ef1-c7765b188ed1 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34812025-06-18T18:48:05.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7b5a5160-b25b-44ce-8ef1-c7765b188ed1 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34822025-06-18T18:48:05.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2050 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7b5a5160-b25b-44ce-8ef1-c7765b188ed1 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34832025-06-18T18:48:06.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ec6a530c-167a-49b1-9eef-1c15db86f5d4 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34842025-06-18T18:48:06.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ec6a530c-167a-49b1-9eef-1c15db86f5d4 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34852025-06-18T18:48:06.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2697 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ec6a530c-167a-49b1-9eef-1c15db86f5d4 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
34862025-06-18T18:48:07.558ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
34872025-06-18T18:48:07.558ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34882025-06-18T18:48:07.558ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
34892025-06-18T18:48:07.558ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34902025-06-18T18:48:07.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34912025-06-18T18:48:07.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34922025-06-18T18:48:07.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34932025-06-18T18:48:07.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34942025-06-18T18:48:07.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34952025-06-18T18:48:07.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34962025-06-18T18:48:07.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34972025-06-18T18:48:07.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34982025-06-18T18:48:07.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34992025-06-18T18:48:07.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35002025-06-18T18:48:07.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35012025-06-18T18:48:07.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
35022025-06-18T18:48:07.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35032025-06-18T18:48:07.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35042025-06-18T18:48:07.583ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
35052025-06-18T18:48:07.583ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.863953ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
35062025-06-18T18:48:07.592ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.35185ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35072025-06-18T18:48:07.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 93346901-19e2-4d97-8f6b-25ed7d12a74e roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35082025-06-18T18:48:07.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 93346901-19e2-4d97-8f6b-25ed7d12a74e resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35092025-06-18T18:48:07.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2136 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 93346901-19e2-4d97-8f6b-25ed7d12a74e response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35102025-06-18T18:48:08.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 620bc30a-7b4f-4824-9976-828d1388e080 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35112025-06-18T18:48:08.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 620bc30a-7b4f-4824-9976-828d1388e080 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35122025-06-18T18:48:08.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2263 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 620bc30a-7b4f-4824-9976-828d1388e080 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35132025-06-18T18:48:09.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a187c7b2-a2a3-491a-94ab-34f36dc924b2 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35142025-06-18T18:48:09.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a187c7b2-a2a3-491a-94ab-34f36dc924b2 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35152025-06-18T18:48:09.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2189 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a187c7b2-a2a3-491a-94ab-34f36dc924b2 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35162025-06-18T18:48:10.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 41805a05-e699-44f1-b360-e90a63cf71ca roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35172025-06-18T18:48:10.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 41805a05-e699-44f1-b360-e90a63cf71ca resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35182025-06-18T18:48:10.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2510 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 41805a05-e699-44f1-b360-e90a63cf71ca response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35192025-06-18T18:48:11.134ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 609 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = deb0bb14-2187-4ec7-8c2c-5d6330b27e85 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
35202025-06-18T18:48:11.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3287fc9e-5392-4ffb-9f14-94cd759916a6 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35212025-06-18T18:48:11.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3287fc9e-5392-4ffb-9f14-94cd759916a6 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35222025-06-18T18:48:11.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2371 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3287fc9e-5392-4ffb-9f14-94cd759916a6 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35232025-06-18T18:48:12.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b8ee3379-cd4e-4a5b-90fa-efdcc18ea1b2 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35242025-06-18T18:48:12.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b8ee3379-cd4e-4a5b-90fa-efdcc18ea1b2 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35252025-06-18T18:48:12.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b8ee3379-cd4e-4a5b-90fa-efdcc18ea1b2 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35262025-06-18T18:48:13.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c47dc95c-6c1c-41ba-abbc-a00bf046cf2c roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35272025-06-18T18:48:13.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c47dc95c-6c1c-41ba-abbc-a00bf046cf2c resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35282025-06-18T18:48:13.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2491 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c47dc95c-6c1c-41ba-abbc-a00bf046cf2c response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35292025-06-18T18:48:14.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 02545f0c-501e-40c0-b7c8-2f411cf7773f roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35302025-06-18T18:48:14.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 02545f0c-501e-40c0-b7c8-2f411cf7773f resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35312025-06-18T18:48:14.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2037 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 02545f0c-501e-40c0-b7c8-2f411cf7773f response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35322025-06-18T18:48:15.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 04f4cbfa-2eda-41f2-b422-124f524b550f roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35332025-06-18T18:48:15.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 04f4cbfa-2eda-41f2-b422-124f524b550f resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35342025-06-18T18:48:15.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2403 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 04f4cbfa-2eda-41f2-b422-124f524b550f response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35352025-06-18T18:48:16.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 2d4c3f76-80b1-4e08-b8f6-b87c6d96aefb roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35362025-06-18T18:48:16.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 2d4c3f76-80b1-4e08-b8f6-b87c6d96aefb resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35372025-06-18T18:48:16.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2114 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 2d4c3f76-80b1-4e08-b8f6-b87c6d96aefb response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
35382025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
35392025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35402025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
35412025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35422025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35432025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
35442025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35452025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
35462025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 26 reason = Timeout
35472025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
35482025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35492025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
35502025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
35512025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
35522025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
35532025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
35542025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35552025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
35562025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
35572025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35582025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
35592025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
35602025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Timeout
35612025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
35622025-06-18T18:48:17.559ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
35632025-06-18T18:48:17.559ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
35642025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35652025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
35662025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35672025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
35682025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35692025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
35702025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35712025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
35722025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
35732025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
35742025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
35752025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
35762025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
35772025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
35782025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
35792025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35802025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35812025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
35822025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
35832025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
35842025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35852025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35862025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35872025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
35882025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35892025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
35902025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35912025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35922025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
35932025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
35942025-06-18T18:48:17.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
35952025-06-18T18:48:17.562ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35962025-06-18T18:48:17.563ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35972025-06-18T18:48:17.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
35982025-06-18T18:48:17.564ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
35992025-06-18T18:48:17.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36002025-06-18T18:48:17.565ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.528636ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
36012025-06-18T18:48:17.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
36022025-06-18T18:48:17.567ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36032025-06-18T18:48:17.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36042025-06-18T18:48:17.567ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1687, tv_nsec: 147366634 } })
36052025-06-18T18:48:17.567ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
36062025-06-18T18:48:17.569ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36072025-06-18T18:48:17.569ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36082025-06-18T18:48:17.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36092025-06-18T18:48:17.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
36102025-06-18T18:48:17.572ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
36112025-06-18T18:48:17.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
36122025-06-18T18:48:17.574ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36132025-06-18T18:48:17.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36142025-06-18T18:48:17.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36152025-06-18T18:48:17.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36162025-06-18T18:48:17.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36172025-06-18T18:48:17.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36182025-06-18T18:48:17.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36192025-06-18T18:48:17.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36202025-06-18T18:48:17.582ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1687, tv_nsec: 162324740 } })
36212025-06-18T18:48:17.582ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
36222025-06-18T18:48:17.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36232025-06-18T18:48:17.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36242025-06-18T18:48:17.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36252025-06-18T18:48:17.585ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36262025-06-18T18:48:17.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36272025-06-18T18:48:17.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36282025-06-18T18:48:17.586ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36292025-06-18T18:48:17.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
36302025-06-18T18:48:17.594ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36312025-06-18T18:48:17.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36322025-06-18T18:48:17.607ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
36332025-06-18T18:48:17.607ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.005012ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
36342025-06-18T18:48:17.614ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36352025-06-18T18:48:17.614ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36362025-06-18T18:48:17.614ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
36372025-06-18T18:48:17.614ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36382025-06-18T18:48:17.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36392025-06-18T18:48:17.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36402025-06-18T18:48:17.614ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b12ab8d-9282-48f9-a30c-9e0323cb341e", "content-length": "26", "date": "Wed, 18 Jun 2025 18:48:17 GMT"} })
36412025-06-18T18:48:17.615ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36422025-06-18T18:48:17.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36432025-06-18T18:48:17.616ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36442025-06-18T18:48:17.616ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36452025-06-18T18:48:17.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36462025-06-18T18:48:17.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
36472025-06-18T18:48:17.618ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36482025-06-18T18:48:17.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36492025-06-18T18:48:17.620ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36502025-06-18T18:48:17.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36512025-06-18T18:48:17.621ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 61.845973ms iteration = 26 status = {"errors":[],"requests_created_ok":[]}
36522025-06-18T18:48:17.622ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1687, tv_nsec: 201823515 } })
36532025-06-18T18:48:17.622ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
36542025-06-18T18:48:17.624ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 64.5598ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
36552025-06-18T18:48:17.624ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36562025-06-18T18:48:17.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36572025-06-18T18:48:17.626ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
36582025-06-18T18:48:17.626ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
36592025-06-18T18:48:17.626ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
36602025-06-18T18:48:17.626ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "af8e28d3-6cea-4e5b-b818-39ab5127840d", "content-length": "26", "date": "Wed, 18 Jun 2025 18:48:17 GMT"} })
36612025-06-18T18:48:17.626ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
36622025-06-18T18:48:17.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
36632025-06-18T18:48:17.627ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36642025-06-18T18:48:17.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36652025-06-18T18:48:17.628ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36662025-06-18T18:48:17.628ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
36672025-06-18T18:48:17.629ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36682025-06-18T18:48:17.629ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 69.406828ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
36692025-06-18T18:48:17.629ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36702025-06-18T18:48:17.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
36712025-06-18T18:48:17.631ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
36722025-06-18T18:48:17.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
36732025-06-18T18:48:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36742025-06-18T18:48:17.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36752025-06-18T18:48:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9fbbc826-5b83-4b80-8172-66302c618aae, lookup_type: ById(9fbbc826-5b83-4b80-8172-66302c618aae) } result = Ok(())
36762025-06-18T18:48:17.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36772025-06-18T18:48:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36782025-06-18T18:48:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36792025-06-18T18:48:17.636ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
36802025-06-18T18:48:17.636ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.690678ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
36812025-06-18T18:48:17.636ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36822025-06-18T18:48:17.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36832025-06-18T18:48:17.636ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36842025-06-18T18:48:17.636ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
36852025-06-18T18:48:17.636ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36862025-06-18T18:48:17.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36872025-06-18T18:48:17.638ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36882025-06-18T18:48:17.638ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 78.810647ms iteration = 26 status = 0
36892025-06-18T18:48:17.638ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36902025-06-18T18:48:17.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36912025-06-18T18:48:17.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36922025-06-18T18:48:17.640ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
36932025-06-18T18:48:17.640ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
36942025-06-18T18:48:17.640ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36952025-06-18T18:48:17.641ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36962025-06-18T18:48:17.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36972025-06-18T18:48:17.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
36982025-06-18T18:48:17.643ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36992025-06-18T18:48:17.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37002025-06-18T18:48:17.646ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37012025-06-18T18:48:17.646ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
37022025-06-18T18:48:17.646ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 86.084218ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
37032025-06-18T18:48:17.653ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.223686ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37042025-06-18T18:48:17.655ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 95.787392ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37052025-06-18T18:48:17.658ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 98.874714ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37062025-06-18T18:48:17.671ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 111.280675ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
37072025-06-18T18:48:17.672ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
37082025-06-18T18:48:17.672ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 112.187478ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
37092025-06-18T18:48:17.684ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 124.605349ms iteration = 29 status = {"physical_disks_added":0}
37102025-06-18T18:48:17.696ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37112025-06-18T18:48:17.696ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f zone_address = fd00:1122:3344:101::2
37122025-06-18T18:48:17.696ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37132025-06-18T18:48:17.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37142025-06-18T18:48:17.696ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4da9e859-59bb-4514-8b99-a8389959de21", "content-length": "26", "date": "Wed, 18 Jun 2025 18:48:17 GMT"} })
37152025-06-18T18:48:17.696ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37162025-06-18T18:48:17.698ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
37172025-06-18T18:48:17.698ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 138.424709ms iteration = 26 status = null
37182025-06-18T18:48:17.706ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 146.461381ms iteration = 26 status = {}
37192025-06-18T18:48:17.724ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37202025-06-18T18:48:17.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37212025-06-18T18:48:17.726ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37222025-06-18T18:48:17.728ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37232025-06-18T18:48:17.728ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37242025-06-18T18:48:17.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37252025-06-18T18:48:17.730ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
37262025-06-18T18:48:17.730ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37272025-06-18T18:48:17.730ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "220cc43c-5185-48e1-aaff-3a913d4dba3e", "content-length": "372", "date": "Wed, 18 Jun 2025 18:48:17 GMT"} })
37282025-06-18T18:48:17.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37292025-06-18T18:48:17.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37302025-06-18T18:48:17.763ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37312025-06-18T18:48:17.765ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
37322025-06-18T18:48:17.765ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37332025-06-18T18:48:17.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37342025-06-18T18:48:17.776ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
37352025-06-18T18:48:17.776ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
37362025-06-18T18:48:17.777ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1db7e14d-3e7e-4044-bb21-c002ac648ec1", "date": "Wed, 18 Jun 2025 18:48:17 GMT"} })
37372025-06-18T18:48:17.777ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37382025-06-18T18:48:17.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37392025-06-18T18:48:17.779ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37402025-06-18T18:48:17.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37412025-06-18T18:48:17.782ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37422025-06-18T18:48:17.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37432025-06-18T18:48:17.785ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
37442025-06-18T18:48:17.785ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
37452025-06-18T18:48:17.785ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2ebdeae3-afa2-48f6-b61e-00da8576caff", "date": "Wed, 18 Jun 2025 18:48:17 GMT"} })
37462025-06-18T18:48:17.786ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 227.007852ms iteration = 27 status = {}
37472025-06-18T18:48:17.827ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37482025-06-18T18:48:17.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37492025-06-18T18:48:17.829ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
37502025-06-18T18:48:17.830ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 7e1ff921-047f-464e-8081-f8132af716ac, rack_id: 3a330d2e-6212-46a4-9781-374fdb3dc92f, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(6c07c314-d66b-4041-9040-d774200d26a9) } rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
37512025-06-18T18:48:17.830ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37522025-06-18T18:48:17.830ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c7004d4-8e13-47e9-a454-2ad68ba63948", "content-length": "691", "date": "Wed, 18 Jun 2025 18:48:17 GMT"} })
37532025-06-18T18:48:17.830ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
37542025-06-18T18:48:17.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37552025-06-18T18:48:17.830ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
37562025-06-18T18:48:17.830ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
37572025-06-18T18:48:17.831ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 271.919001ms iteration = 27 status = {}
37582025-06-18T18:48:17.842ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
37592025-06-18T18:48:17.842ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 6c07c314-d66b-4041-9040-d774200d26a9
37602025-06-18T18:48:17.842ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
37612025-06-18T18:48:17.842ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
37622025-06-18T18:48:17.842ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37632025-06-18T18:48:17.842ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37642025-06-18T18:48:17.842ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37652025-06-18T18:48:17.842ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37662025-06-18T18:48:17.842ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
37672025-06-18T18:48:17.842ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
37682025-06-18T18:48:17.842ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
37692025-06-18T18:48:17.842ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37702025-06-18T18:48:17.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37712025-06-18T18:48:17.845ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
37722025-06-18T18:48:17.845ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
37732025-06-18T18:48:17.945ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2bd6601f-96a7-4e28-8ac0-e575dcecbe8e", "date": "Wed, 18 Jun 2025 18:48:17 GMT"} })
37742025-06-18T18:48:17.945ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch = Switch0
37752025-06-18T18:48:17.945ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
37762025-06-18T18:48:17.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 79e66b37-0a8d-4407-ad8a-e5650fcdb13a roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
37772025-06-18T18:48:17.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 79e66b37-0a8d-4407-ad8a-e5650fcdb13a resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
37782025-06-18T18:48:17.946ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4022e8d-d468-45e3-9d75-2e0e520c4e3b", "content-length": "682", "date": "Wed, 18 Jun 2025 18:48:17 GMT"} })
37792025-06-18T18:48:17.946ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37802025-06-18T18:48:17.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37812025-06-18T18:48:17.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2720 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 79e66b37-0a8d-4407-ad8a-e5650fcdb13a response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
37822025-06-18T18:48:17.951ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37832025-06-18T18:48:17.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37842025-06-18T18:48:17.954ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37852025-06-18T18:48:17.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37862025-06-18T18:48:17.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37872025-06-18T18:48:17.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37882025-06-18T18:48:17.964ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 404.44482ms iteration = 26 status = {}
37892025-06-18T18:48:18.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = fd03d058-3a96-4515-85c8-4123e5b74296 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
37902025-06-18T18:48:18.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = fd03d058-3a96-4515-85c8-4123e5b74296 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
37912025-06-18T18:48:18.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2636 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = fd03d058-3a96-4515-85c8-4123e5b74296 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
37922025-06-18T18:48:19.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1e3c7a64-5892-4b3a-8e0e-4dcc112b5c2b roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
37932025-06-18T18:48:19.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1e3c7a64-5892-4b3a-8e0e-4dcc112b5c2b resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
37942025-06-18T18:48:19.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2817 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1e3c7a64-5892-4b3a-8e0e-4dcc112b5c2b response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
37952025-06-18T18:48:20.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e41f265e-994b-47bc-81f6-867714f0e2f8 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
37962025-06-18T18:48:20.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e41f265e-994b-47bc-81f6-867714f0e2f8 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
37972025-06-18T18:48:20.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2706 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e41f265e-994b-47bc-81f6-867714f0e2f8 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
37982025-06-18T18:48:21.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39667 req_id = b555d4cb-973d-415f-854d-e39a5161f89a roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
37992025-06-18T18:48:21.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39667 req_id = b555d4cb-973d-415f-854d-e39a5161f89a resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
38002025-06-18T18:48:21.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3736 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39667 req_id = b555d4cb-973d-415f-854d-e39a5161f89a response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
38012025-06-18T18:48:21.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39667 req_id = 49c8236a-b89f-4188-babf-b94b573079f7 roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
38022025-06-18T18:48:21.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39667 req_id = 49c8236a-b89f-4188-babf-b94b573079f7 resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
38032025-06-18T18:48:21.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2356 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39667 req_id = 49c8236a-b89f-4188-babf-b94b573079f7 response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
38042025-06-18T18:48:21.133ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 540 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 213dbe1f-76ab-4ce2-8182-b6ec0b9bf2d2 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
38052025-06-18T18:48:22.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 62ac42ac-2c16-4d8b-8d4b-6d9e69d1ef22 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38062025-06-18T18:48:22.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 62ac42ac-2c16-4d8b-8d4b-6d9e69d1ef22 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38072025-06-18T18:48:22.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2421 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 62ac42ac-2c16-4d8b-8d4b-6d9e69d1ef22 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38082025-06-18T18:48:23.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ba4fe558-4686-454e-8c54-37a9e7a3cd51 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38092025-06-18T18:48:23.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ba4fe558-4686-454e-8c54-37a9e7a3cd51 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38102025-06-18T18:48:23.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2437 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ba4fe558-4686-454e-8c54-37a9e7a3cd51 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38112025-06-18T18:48:24.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = fa988eda-4c3a-47f7-8520-658814e43b23 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38122025-06-18T18:48:24.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = fa988eda-4c3a-47f7-8520-658814e43b23 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38132025-06-18T18:48:24.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2142 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = fa988eda-4c3a-47f7-8520-658814e43b23 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38142025-06-18T18:48:25.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 2c660ae0-dfe7-4466-95d4-c4a95b73bad6 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38152025-06-18T18:48:25.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 2c660ae0-dfe7-4466-95d4-c4a95b73bad6 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38162025-06-18T18:48:25.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3051 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 2c660ae0-dfe7-4466-95d4-c4a95b73bad6 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38172025-06-18T18:48:26.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 37cfc109-d6ad-4253-af7d-9087edb584dd roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38182025-06-18T18:48:26.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 37cfc109-d6ad-4253-af7d-9087edb584dd resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38192025-06-18T18:48:26.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2479 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 37cfc109-d6ad-4253-af7d-9087edb584dd response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38202025-06-18T18:48:27.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a442f026-c4f4-4dfb-a08a-c4b694f19e6f roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38212025-06-18T18:48:27.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a442f026-c4f4-4dfb-a08a-c4b694f19e6f resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38222025-06-18T18:48:27.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2481 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a442f026-c4f4-4dfb-a08a-c4b694f19e6f response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38232025-06-18T18:48:27.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
38242025-06-18T18:48:27.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38252025-06-18T18:48:27.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
38262025-06-18T18:48:27.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38272025-06-18T18:48:27.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38282025-06-18T18:48:27.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38292025-06-18T18:48:27.562ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38302025-06-18T18:48:27.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38312025-06-18T18:48:27.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38322025-06-18T18:48:27.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38332025-06-18T18:48:27.594ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38342025-06-18T18:48:27.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38352025-06-18T18:48:27.595ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.541901ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38362025-06-18T18:48:27.597ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38372025-06-18T18:48:27.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38382025-06-18T18:48:27.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38392025-06-18T18:48:27.601ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
38402025-06-18T18:48:27.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38412025-06-18T18:48:27.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38422025-06-18T18:48:27.613ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
38432025-06-18T18:48:27.613ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.550819ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
38442025-06-18T18:48:28.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5dc1ea37-ddf8-4194-b396-6b1dbaee34dd roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38452025-06-18T18:48:28.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5dc1ea37-ddf8-4194-b396-6b1dbaee34dd resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38462025-06-18T18:48:28.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1991 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5dc1ea37-ddf8-4194-b396-6b1dbaee34dd response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38472025-06-18T18:48:29.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 418c2fe2-f767-4e63-9d9b-80ae7d08f87d roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38482025-06-18T18:48:29.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 418c2fe2-f767-4e63-9d9b-80ae7d08f87d resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38492025-06-18T18:48:29.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2449 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 418c2fe2-f767-4e63-9d9b-80ae7d08f87d response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38502025-06-18T18:48:30.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = dfdefaef-7341-4222-888b-ac50179d0e23 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38512025-06-18T18:48:30.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = dfdefaef-7341-4222-888b-ac50179d0e23 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38522025-06-18T18:48:30.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2672 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = dfdefaef-7341-4222-888b-ac50179d0e23 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38532025-06-18T18:48:31.134ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1029 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 52985183-1a20-43c2-8520-fe6c1a6c6290 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
38542025-06-18T18:48:31.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f7ebe7fd-c788-4bd1-af0f-3a82740f6c96 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38552025-06-18T18:48:31.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f7ebe7fd-c788-4bd1-af0f-3a82740f6c96 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38562025-06-18T18:48:31.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2807 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f7ebe7fd-c788-4bd1-af0f-3a82740f6c96 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38572025-06-18T18:48:32.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 45e76bc4-91d6-4d3e-a9b4-603794fda31d roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38582025-06-18T18:48:32.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 45e76bc4-91d6-4d3e-a9b4-603794fda31d resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38592025-06-18T18:48:32.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2728 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 45e76bc4-91d6-4d3e-a9b4-603794fda31d response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38602025-06-18T18:48:33.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ec9f26a2-2909-4073-8471-56616dde13d9 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38612025-06-18T18:48:33.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ec9f26a2-2909-4073-8471-56616dde13d9 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38622025-06-18T18:48:33.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2251 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ec9f26a2-2909-4073-8471-56616dde13d9 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38632025-06-18T18:48:34.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9ef8bfc7-adeb-4e60-8444-f97765c42f15 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38642025-06-18T18:48:34.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9ef8bfc7-adeb-4e60-8444-f97765c42f15 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38652025-06-18T18:48:34.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2532 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9ef8bfc7-adeb-4e60-8444-f97765c42f15 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38662025-06-18T18:48:35.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 38516c59-55e8-42ca-be32-8903df2b025d roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38672025-06-18T18:48:35.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 38516c59-55e8-42ca-be32-8903df2b025d resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38682025-06-18T18:48:35.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2480 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 38516c59-55e8-42ca-be32-8903df2b025d response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38692025-06-18T18:48:36.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 276cf7d0-bef3-44df-9353-1a1aa0f07a02 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38702025-06-18T18:48:36.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 276cf7d0-bef3-44df-9353-1a1aa0f07a02 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38712025-06-18T18:48:36.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2251 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 276cf7d0-bef3-44df-9353-1a1aa0f07a02 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38722025-06-18T18:48:37.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 967211aa-29d1-48ff-bef0-21a1f3518cc0 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38732025-06-18T18:48:37.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 967211aa-29d1-48ff-bef0-21a1f3518cc0 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38742025-06-18T18:48:37.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2463 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 967211aa-29d1-48ff-bef0-21a1f3518cc0 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38752025-06-18T18:48:37.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
38762025-06-18T18:48:37.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
38772025-06-18T18:48:37.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38782025-06-18T18:48:37.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38792025-06-18T18:48:37.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38802025-06-18T18:48:37.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38812025-06-18T18:48:37.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38822025-06-18T18:48:37.562ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38832025-06-18T18:48:37.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38842025-06-18T18:48:37.564ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.528423ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38852025-06-18T18:48:37.564ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38862025-06-18T18:48:37.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38872025-06-18T18:48:37.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38882025-06-18T18:48:37.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38892025-06-18T18:48:37.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38902025-06-18T18:48:37.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38912025-06-18T18:48:37.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
38922025-06-18T18:48:37.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38932025-06-18T18:48:37.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38942025-06-18T18:48:37.580ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
38952025-06-18T18:48:37.580ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.132062ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
38962025-06-18T18:48:38.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 013f3956-80a4-4461-a978-be62dbe43c83 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38972025-06-18T18:48:38.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 013f3956-80a4-4461-a978-be62dbe43c83 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38982025-06-18T18:48:38.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1601 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 013f3956-80a4-4461-a978-be62dbe43c83 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
38992025-06-18T18:48:39.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 23f4a182-efc3-4a5c-a198-8c2032284dde roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39002025-06-18T18:48:39.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 23f4a182-efc3-4a5c-a198-8c2032284dde resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39012025-06-18T18:48:39.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2264 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 23f4a182-efc3-4a5c-a198-8c2032284dde response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39022025-06-18T18:48:40.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3aed4fcb-ef9f-452e-aacb-381866f06f44 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39032025-06-18T18:48:40.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3aed4fcb-ef9f-452e-aacb-381866f06f44 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39042025-06-18T18:48:40.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3091 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3aed4fcb-ef9f-452e-aacb-381866f06f44 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39052025-06-18T18:48:41.134ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 563 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 70ee24c0-6a77-4691-9e4f-84725500887b response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
39062025-06-18T18:48:41.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b4886bb1-6ab7-4ca1-b6b1-cbc42612b2ae roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39072025-06-18T18:48:41.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b4886bb1-6ab7-4ca1-b6b1-cbc42612b2ae resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39082025-06-18T18:48:41.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2578 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b4886bb1-6ab7-4ca1-b6b1-cbc42612b2ae response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39092025-06-18T18:48:42.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a0a52323-3469-4c92-b11f-fa5cb3cd7643 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39102025-06-18T18:48:42.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a0a52323-3469-4c92-b11f-fa5cb3cd7643 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39112025-06-18T18:48:42.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2428 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a0a52323-3469-4c92-b11f-fa5cb3cd7643 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39122025-06-18T18:48:43.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d42dc823-fffd-4ccb-9942-8e9b7c7751a2 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39132025-06-18T18:48:43.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d42dc823-fffd-4ccb-9942-8e9b7c7751a2 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39142025-06-18T18:48:43.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2873 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d42dc823-fffd-4ccb-9942-8e9b7c7751a2 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39152025-06-18T18:48:44.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f9d0430f-77a5-486b-808a-3913ac2f00eb roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39162025-06-18T18:48:44.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f9d0430f-77a5-486b-808a-3913ac2f00eb resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39172025-06-18T18:48:44.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2657 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f9d0430f-77a5-486b-808a-3913ac2f00eb response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39182025-06-18T18:48:45.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8f819b9c-8d48-4ee3-acc9-2d3269245fbf roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39192025-06-18T18:48:45.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8f819b9c-8d48-4ee3-acc9-2d3269245fbf resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39202025-06-18T18:48:45.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8f819b9c-8d48-4ee3-acc9-2d3269245fbf response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39212025-06-18T18:48:46.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 89fd8f1f-e2f3-4257-bd30-b2dcef4b29ad roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39222025-06-18T18:48:46.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 89fd8f1f-e2f3-4257-bd30-b2dcef4b29ad resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39232025-06-18T18:48:46.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2441 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 89fd8f1f-e2f3-4257-bd30-b2dcef4b29ad response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39242025-06-18T18:48:47.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0d319777-4b4a-4028-a673-0c73f16df6ca roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39252025-06-18T18:48:47.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0d319777-4b4a-4028-a673-0c73f16df6ca resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39262025-06-18T18:48:47.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2258 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0d319777-4b4a-4028-a673-0c73f16df6ca response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
39272025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
39282025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39292025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 27 reason = Timeout
39302025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
39312025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
39322025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39332025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
39342025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
39352025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39362025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39372025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
39382025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39392025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 14 reason = Timeout
39402025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
39412025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
39422025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
39432025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
39442025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39452025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
39462025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39472025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
39482025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39492025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
39502025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39512025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
39522025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39532025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
39542025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
39552025-06-18T18:48:47.560ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
39562025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39572025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39582025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
39592025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
39602025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39612025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
39622025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39632025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
39642025-06-18T18:48:47.560ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-18 18:38:47.560673275 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
39652025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
39662025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
39672025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39682025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
39692025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39702025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
39712025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39722025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
39732025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39742025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
39752025-06-18T18:48:47.560ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
39762025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
39772025-06-18T18:48:47.560ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe
39782025-06-18T18:48:47.560ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
39792025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.21\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe"}
39802025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 14 reason = Timeout
39812025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
39822025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
39832025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
39842025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
39852025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
39862025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
39872025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
39882025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 27 reason = Timeout
39892025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39902025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
39912025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
39922025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
39932025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
39942025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
39952025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
39962025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
39972025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39982025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39992025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
40002025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40012025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40022025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
40032025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40042025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40052025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
40062025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40072025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40082025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
40092025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40102025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
40112025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40122025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40132025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
40142025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40152025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
40162025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40172025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40182025-06-18T18:48:47.561ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("51411444-5ad0-46e8-b345-7ee26fb32a60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("adea75c9-2ff2-4f9f-bfac-48c7702333e0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea7c6eed-68db-4cd0-929a-17b08777d263.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea7c6eed-68db-4cd0-929a-17b08777d263.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1717, tv_nsec: 141068849 } })
40192025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40202025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
40212025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
40222025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40232025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
40242025-06-18T18:48:47.561ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("03fce462-e4e1-4a86-890b-8a2ae9e17168.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("800703b5-0601-4ce2-acc3-d5b9ca473160.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("800703b5-0601-4ce2-acc3-d5b9ca473160.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1717, tv_nsec: 141114190 } })
40252025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40262025-06-18T18:48:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
40272025-06-18T18:48:47.562ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
40282025-06-18T18:48:47.562ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.49144ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
40292025-06-18T18:48:47.562ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
40302025-06-18T18:48:47.562ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.494441ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
40312025-06-18T18:48:47.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40322025-06-18T18:48:47.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40332025-06-18T18:48:47.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40342025-06-18T18:48:47.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40352025-06-18T18:48:47.566ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 6.275036ms iteration = 27 status = {"errors":[],"requests_created_ok":[]}
40362025-06-18T18:48:47.566ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.898131ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
40372025-06-18T18:48:47.567ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40382025-06-18T18:48:47.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40392025-06-18T18:48:47.568ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1717, tv_nsec: 147950094 } })
40402025-06-18T18:48:47.568ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40412025-06-18T18:48:47.568ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
40422025-06-18T18:48:47.569ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40432025-06-18T18:48:47.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40442025-06-18T18:48:47.571ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40452025-06-18T18:48:47.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40462025-06-18T18:48:47.572ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
40472025-06-18T18:48:47.572ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40482025-06-18T18:48:47.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40492025-06-18T18:48:47.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40502025-06-18T18:48:47.576ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-18 18:38:47.560673275 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
40512025-06-18T18:48:47.576ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.620515ms iteration = 14 status = {"expiration":"2025-06-18T18:38:47.560673275Z","pruned":[]}
40522025-06-18T18:48:47.577ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40532025-06-18T18:48:47.577ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40542025-06-18T18:48:47.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40552025-06-18T18:48:47.580ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40562025-06-18T18:48:47.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40572025-06-18T18:48:47.582ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
40582025-06-18T18:48:47.582ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
40592025-06-18T18:48:47.582ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 21.323334ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
40602025-06-18T18:48:47.582ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40612025-06-18T18:48:47.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40622025-06-18T18:48:47.583ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1717, tv_nsec: 162661947 } })
40632025-06-18T18:48:47.583ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
40642025-06-18T18:48:47.583ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 22.648343ms iteration = 14 status = {"by_rx":{},"error":null}
40652025-06-18T18:48:47.583ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
40662025-06-18T18:48:47.584ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40672025-06-18T18:48:47.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40682025-06-18T18:48:47.585ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 24.429087ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
40692025-06-18T18:48:47.586ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
40702025-06-18T18:48:47.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
40712025-06-18T18:48:47.587ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1717, tv_nsec: 166861195 } })
40722025-06-18T18:48:47.587ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
40732025-06-18T18:48:47.588ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40742025-06-18T18:48:47.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40752025-06-18T18:48:47.615ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.813556ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
40762025-06-18T18:48:47.617ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40772025-06-18T18:48:47.617ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40782025-06-18T18:48:47.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40792025-06-18T18:48:47.620ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40802025-06-18T18:48:47.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40812025-06-18T18:48:47.622ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40822025-06-18T18:48:47.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
40832025-06-18T18:48:47.624ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40842025-06-18T18:48:47.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40852025-06-18T18:48:47.625ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40862025-06-18T18:48:47.625ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 64.719982ms iteration = 14 status = {"dispatched":[],"errors":[],"glob_version":"150.0.0","globs_reprocessed":{},"no_receivers":[]}
40872025-06-18T18:48:47.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
40882025-06-18T18:48:47.625ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
40892025-06-18T18:48:47.626ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40902025-06-18T18:48:47.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
40912025-06-18T18:48:47.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40922025-06-18T18:48:47.628ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40932025-06-18T18:48:47.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
40942025-06-18T18:48:47.628ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40952025-06-18T18:48:47.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40962025-06-18T18:48:47.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40972025-06-18T18:48:47.630ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40982025-06-18T18:48:47.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40992025-06-18T18:48:47.630ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41002025-06-18T18:48:47.630ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
41012025-06-18T18:48:47.630ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41022025-06-18T18:48:47.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41032025-06-18T18:48:47.632ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41042025-06-18T18:48:47.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41052025-06-18T18:48:47.632ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41062025-06-18T18:48:47.633ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41072025-06-18T18:48:47.633ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41082025-06-18T18:48:47.634ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41092025-06-18T18:48:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41102025-06-18T18:48:47.635ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41112025-06-18T18:48:47.635ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
41122025-06-18T18:48:47.635ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41132025-06-18T18:48:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41142025-06-18T18:48:47.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
41152025-06-18T18:48:47.636ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
41162025-06-18T18:48:47.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
41172025-06-18T18:48:47.637ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41182025-06-18T18:48:47.637ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41192025-06-18T18:48:47.637ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41202025-06-18T18:48:47.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41212025-06-18T18:48:47.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41222025-06-18T18:48:47.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 77.471369ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
41232025-06-18T18:48:47.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41242025-06-18T18:48:47.638ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41252025-06-18T18:48:47.638ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
41262025-06-18T18:48:47.638ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 77.620651ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
41272025-06-18T18:48:47.638ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41282025-06-18T18:48:47.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41292025-06-18T18:48:47.642ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41302025-06-18T18:48:47.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
41312025-06-18T18:48:47.642ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41322025-06-18T18:48:47.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41332025-06-18T18:48:47.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41342025-06-18T18:48:47.645ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41352025-06-18T18:48:47.645ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
41362025-06-18T18:48:47.645ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 85.563341ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
41372025-06-18T18:48:47.647ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 86.98657ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41382025-06-18T18:48:47.647ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41392025-06-18T18:48:47.647ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41402025-06-18T18:48:47.647ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41412025-06-18T18:48:47.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41422025-06-18T18:48:47.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41432025-06-18T18:48:47.671ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
41442025-06-18T18:48:47.671ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
41452025-06-18T18:48:47.671ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
41462025-06-18T18:48:47.671ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41472025-06-18T18:48:47.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41482025-06-18T18:48:47.676ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41492025-06-18T18:48:47.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41502025-06-18T18:48:47.678ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41512025-06-18T18:48:47.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41522025-06-18T18:48:47.680ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41532025-06-18T18:48:47.680ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
41542025-06-18T18:48:47.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41552025-06-18T18:48:47.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9fbbc826-5b83-4b80-8172-66302c618aae, lookup_type: ById(9fbbc826-5b83-4b80-8172-66302c618aae) } result = Ok(())
41562025-06-18T18:48:47.683ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41572025-06-18T18:48:47.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41582025-06-18T18:48:47.684ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
41592025-06-18T18:48:47.684ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
41602025-06-18T18:48:47.684ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 123.749907ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
41612025-06-18T18:48:47.685ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41622025-06-18T18:48:47.685ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 124.899783ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41632025-06-18T18:48:47.685ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 125.272738ms iteration = 27 status = 0
41642025-06-18T18:48:47.686ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41652025-06-18T18:48:47.686ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
41662025-06-18T18:48:47.686ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 126.05469ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
41672025-06-18T18:48:47.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
41682025-06-18T18:48:47.687ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
41692025-06-18T18:48:47.687ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 127.319057ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
41702025-06-18T18:48:47.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41712025-06-18T18:48:47.687ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
41722025-06-18T18:48:47.687ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
41732025-06-18T18:48:47.687ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
41742025-06-18T18:48:47.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41752025-06-18T18:48:47.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41762025-06-18T18:48:47.689ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41772025-06-18T18:48:47.690ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41782025-06-18T18:48:47.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41792025-06-18T18:48:47.691ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41802025-06-18T18:48:47.693ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41812025-06-18T18:48:47.693ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41822025-06-18T18:48:47.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41832025-06-18T18:48:47.694ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
41842025-06-18T18:48:47.694ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41852025-06-18T18:48:47.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41862025-06-18T18:48:47.694ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 134.217002ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41872025-06-18T18:48:47.708ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41882025-06-18T18:48:47.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
41892025-06-18T18:48:47.712ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41902025-06-18T18:48:47.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41912025-06-18T18:48:47.714ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
41922025-06-18T18:48:47.721ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
41932025-06-18T18:48:47.721ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 160.849149ms iteration = 27 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
41942025-06-18T18:48:47.730ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
41952025-06-18T18:48:47.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
41962025-06-18T18:48:47.730ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41972025-06-18T18:48:47.730ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
41982025-06-18T18:48:47.730ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 72dd4529-6655-4d30-a1d8-0de429d0133c dns_zone_name = oxide.test found_so_far = 0 version = 2
41992025-06-18T18:48:47.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42002025-06-18T18:48:47.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42012025-06-18T18:48:47.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42022025-06-18T18:48:47.732ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42032025-06-18T18:48:47.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42042025-06-18T18:48:47.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42052025-06-18T18:48:47.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42062025-06-18T18:48:47.738ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 72dd4529-6655-4d30-a1d8-0de429d0133c dns_zone_name = oxide.test found_so_far = 4 version = 2
42072025-06-18T18:48:47.738ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
42082025-06-18T18:48:47.738ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-18 18:36:20.010620 UTC dns_group = external generation = 2
42092025-06-18T18:48:47.738ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 177.759433ms iteration = 14 status = {"generation":2}
42102025-06-18T18:48:47.738ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
42112025-06-18T18:48:47.738ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42122025-06-18T18:48:47.739ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "44f958b4-e007-407c-a917-406764568b3f", "content-length": "26", "date": "Wed, 18 Jun 2025 18:48:47 GMT"} })
42132025-06-18T18:48:47.739ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42142025-06-18T18:48:47.739ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42152025-06-18T18:48:47.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42162025-06-18T18:48:47.741ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42172025-06-18T18:48:47.741ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42182025-06-18T18:48:47.743ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42192025-06-18T18:48:47.743ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42202025-06-18T18:48:47.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42212025-06-18T18:48:47.744ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-18T18:35:46.206089Z, time_modified: 2025-06-18T18:35:46.206089Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 472c0288-095b-456c-b18f-d5f22a8efd72, db_silo: Silo { identity: SiloIdentity { id: 472c0288-095b-456c-b18f-d5f22a8efd72, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-18T18:36:19.955323Z, time_modified: 2025-06-18T18:36:19.955323Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 472c0288-095b-456c-b18f-d5f22a8efd72, db_silo: Silo { identity: SiloIdentity { id: 472c0288-095b-456c-b18f-d5f22a8efd72, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-18T18:36:19.955323Z, time_modified: 2025-06-18T18:36:19.955323Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3" }] }) }
42222025-06-18T18:48:47.744ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 183.988658ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"472c0288-095b-456c-b18f-d5f22a8efd72","tls_certs":["6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3"]}},"default_endpoint":{"silo_id":"472c0288-095b-456c-b18f-d5f22a8efd72","tls_certs":["6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
42232025-06-18T18:48:47.744ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42242025-06-18T18:48:47.746ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
42252025-06-18T18:48:47.746ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = ab8dd933-5e45-404d-97a3-fdafa1c7d91b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
42262025-06-18T18:48:47.746ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42272025-06-18T18:48:47.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42282025-06-18T18:48:47.747ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
42292025-06-18T18:48:47.747ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42302025-06-18T18:48:47.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42312025-06-18T18:48:47.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42322025-06-18T18:48:47.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42332025-06-18T18:48:47.750ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42342025-06-18T18:48:47.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42352025-06-18T18:48:47.753ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f zone_address = fd00:1122:3344:101::2
42362025-06-18T18:48:47.753ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42372025-06-18T18:48:47.753ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = ab8dd933-5e45-404d-97a3-fdafa1c7d91b dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
42382025-06-18T18:48:47.753ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
42392025-06-18T18:48:47.753ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-18 18:36:19.303122 UTC dns_group = internal generation = 1
42402025-06-18T18:48:47.753ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 192.751029ms iteration = 14 status = {"generation":1}
42412025-06-18T18:48:47.753ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b0913b0-4648-476c-a54f-e5c6d89cc599", "content-length": "26", "date": "Wed, 18 Jun 2025 18:48:47 GMT"} })
42422025-06-18T18:48:47.753ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42432025-06-18T18:48:47.756ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
42442025-06-18T18:48:47.764ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 203.952263ms iteration = 30 status = {"physical_disks_added":0}
42452025-06-18T18:48:47.775ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
42462025-06-18T18:48:47.860ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
42472025-06-18T18:48:47.860ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42482025-06-18T18:48:47.860ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "66c0cdd7-a0ab-434c-90d8-3d3c55757cdb", "content-length": "26", "date": "Wed, 18 Jun 2025 18:48:47 GMT"} })
42492025-06-18T18:48:47.860ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42502025-06-18T18:48:47.863ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42512025-06-18T18:48:47.868ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
42522025-06-18T18:48:47.868ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 307.710485ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
42532025-06-18T18:48:47.883ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
42542025-06-18T18:48:47.910ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 350.155941ms iteration = 27 status = {}
42552025-06-18T18:48:47.946ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
42562025-06-18T18:48:47.946ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42572025-06-18T18:48:47.947ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "def6924e-40f4-4dee-92b2-08697a032379", "content-length": "372", "date": "Wed, 18 Jun 2025 18:48:47 GMT"} })
42582025-06-18T18:48:47.947ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42592025-06-18T18:48:47.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42602025-06-18T18:48:47.948ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
42612025-06-18T18:48:47.948ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3be41fc-d000-46c5-a5cf-a506815912bd", "content-length": "691", "date": "Wed, 18 Jun 2025 18:48:47 GMT"} })
42622025-06-18T18:48:47.948ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
42632025-06-18T18:48:47.948ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
42642025-06-18T18:48:47.948ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
42652025-06-18T18:48:47.949ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 389.426272ms iteration = 28 status = {}
42662025-06-18T18:48:47.965ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
42672025-06-18T18:48:47.965ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
42682025-06-18T18:48:47.965ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8287c9e5-3d7c-44bd-a959-8cc46ef222f5", "date": "Wed, 18 Jun 2025 18:48:47 GMT"} })
42692025-06-18T18:48:47.965ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42702025-06-18T18:48:47.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42712025-06-18T18:48:47.968ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42722025-06-18T18:48:47.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42732025-06-18T18:48:47.971ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42742025-06-18T18:48:47.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42752025-06-18T18:48:47.974ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
42762025-06-18T18:48:47.974ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
42772025-06-18T18:48:47.974ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "26d4c114-67c6-4c47-a9ff-43baf436cfae", "date": "Wed, 18 Jun 2025 18:48:47 GMT"} })
42782025-06-18T18:48:47.975ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 415.31825ms iteration = 28 status = {}
42792025-06-18T18:48:48.005ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
42802025-06-18T18:48:48.006ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "8a0be506-bd99-445c-ab0a-50be26b7fa89", "date": "Wed, 18 Jun 2025 18:48:48 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
42812025-06-18T18:48:48.006ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
42822025-06-18T18:48:48.007ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "15d76204-8180-4daf-ac45-1d7a089fbc1d", "date": "Wed, 18 Jun 2025 18:48:48 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
42832025-06-18T18:48:48.007ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
42842025-06-18T18:48:48.008ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f79b0bea-164d-4e13-b459-45795d42dfe0", "date": "Wed, 18 Jun 2025 18:48:48 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
42852025-06-18T18:48:48.008ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
42862025-06-18T18:48:48.010ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
42872025-06-18T18:48:48.011ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 450.427094ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
42882025-06-18T18:48:48.048ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
42892025-06-18T18:48:48.048ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6d2867bb-30ee-40a1-bc34-c705493ee96c", "date": "Wed, 18 Jun 2025 18:48:48 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42902025-06-18T18:48:48.048ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42912025-06-18T18:48:48.050ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "4320fcce-4409-4d4d-b7a7-f27a5fc5eb31", "date": "Wed, 18 Jun 2025 18:48:48 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42922025-06-18T18:48:48.050ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42932025-06-18T18:48:48.052ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
42942025-06-18T18:48:48.052ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 491.788034ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
42952025-06-18T18:48:48.064ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42962025-06-18T18:48:48.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42972025-06-18T18:48:48.066ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 505.689266ms iteration = 27 status = null
42982025-06-18T18:48:48.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42992025-06-18T18:48:48.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43002025-06-18T18:48:48.086ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 7e1ff921-047f-464e-8081-f8132af716ac, rack_id: 3a330d2e-6212-46a4-9781-374fdb3dc92f, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(6c07c314-d66b-4041-9040-d774200d26a9) } rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
43012025-06-18T18:48:48.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43022025-06-18T18:48:48.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43032025-06-18T18:48:48.099ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
43042025-06-18T18:48:48.099ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 6c07c314-d66b-4041-9040-d774200d26a9
43052025-06-18T18:48:48.099ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
43062025-06-18T18:48:48.099ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
43072025-06-18T18:48:48.099ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43082025-06-18T18:48:48.099ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43092025-06-18T18:48:48.099ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43102025-06-18T18:48:48.099ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
43112025-06-18T18:48:48.099ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
43122025-06-18T18:48:48.099ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
43132025-06-18T18:48:48.100ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
43142025-06-18T18:48:48.100ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43152025-06-18T18:48:48.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43162025-06-18T18:48:48.103ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
43172025-06-18T18:48:48.103ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
43182025-06-18T18:48:48.206ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cb97f1ee-7d0c-4260-9a94-bfa63b56a798", "date": "Wed, 18 Jun 2025 18:48:47 GMT"} })
43192025-06-18T18:48:48.206ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch = Switch0
43202025-06-18T18:48:48.206ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
43212025-06-18T18:48:48.206ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "947018ab-ab08-4e7c-8284-6f9effb2a88d", "content-length": "682", "date": "Wed, 18 Jun 2025 18:48:47 GMT"} })
43222025-06-18T18:48:48.206ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43232025-06-18T18:48:48.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43242025-06-18T18:48:48.210ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43252025-06-18T18:48:48.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43262025-06-18T18:48:48.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43272025-06-18T18:48:48.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43282025-06-18T18:48:48.217ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43292025-06-18T18:48:48.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43302025-06-18T18:48:48.224ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 663.95416ms iteration = 27 status = {}
43312025-06-18T18:48:48.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f41daa6c-10ba-442f-8323-a595124b5833 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43322025-06-18T18:48:48.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f41daa6c-10ba-442f-8323-a595124b5833 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43332025-06-18T18:48:48.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2860 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f41daa6c-10ba-442f-8323-a595124b5833 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43342025-06-18T18:48:49.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 12964b36-33c3-4ded-b74e-d770daef8daa roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43352025-06-18T18:48:49.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 12964b36-33c3-4ded-b74e-d770daef8daa resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43362025-06-18T18:48:49.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1876 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 12964b36-33c3-4ded-b74e-d770daef8daa response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43372025-06-18T18:48:50.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 81d78d77-ff81-484a-bd88-ae756df803b8 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43382025-06-18T18:48:50.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 81d78d77-ff81-484a-bd88-ae756df803b8 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43392025-06-18T18:48:50.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2134 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 81d78d77-ff81-484a-bd88-ae756df803b8 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43402025-06-18T18:48:51.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39667 req_id = 6ebbdc02-a1e8-4cb6-912b-820b8e0ea087 roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
43412025-06-18T18:48:51.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39667 req_id = 6ebbdc02-a1e8-4cb6-912b-820b8e0ea087 resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
43422025-06-18T18:48:51.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3097 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39667 req_id = 6ebbdc02-a1e8-4cb6-912b-820b8e0ea087 response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
43432025-06-18T18:48:51.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39667 req_id = 6bac8195-6b66-44a1-8106-c9890416c0c8 roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
43442025-06-18T18:48:51.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39667 req_id = 6bac8195-6b66-44a1-8106-c9890416c0c8 resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
43452025-06-18T18:48:51.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2767 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39667 req_id = 6bac8195-6b66-44a1-8106-c9890416c0c8 response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
43462025-06-18T18:48:51.134ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 551 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 31eb04eb-469b-4830-8f10-5628fb287ce9 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
43472025-06-18T18:48:51.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c5579dcd-1c7e-4aab-8992-dc1f084c2a0d roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43482025-06-18T18:48:51.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c5579dcd-1c7e-4aab-8992-dc1f084c2a0d resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43492025-06-18T18:48:51.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2775 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c5579dcd-1c7e-4aab-8992-dc1f084c2a0d response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43502025-06-18T18:48:52.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c0164bca-7c25-4aa7-950d-16b050d4688e roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43512025-06-18T18:48:52.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c0164bca-7c25-4aa7-950d-16b050d4688e resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43522025-06-18T18:48:52.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2221 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c0164bca-7c25-4aa7-950d-16b050d4688e response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43532025-06-18T18:48:53.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = beaee703-40e5-49c5-8db5-a60ad4d881d4 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43542025-06-18T18:48:53.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = beaee703-40e5-49c5-8db5-a60ad4d881d4 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43552025-06-18T18:48:53.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2092 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = beaee703-40e5-49c5-8db5-a60ad4d881d4 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43562025-06-18T18:48:54.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 14f3a086-9fe2-4b50-9c86-7563bcbd06cd roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43572025-06-18T18:48:54.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 14f3a086-9fe2-4b50-9c86-7563bcbd06cd resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43582025-06-18T18:48:54.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2515 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 14f3a086-9fe2-4b50-9c86-7563bcbd06cd response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43592025-06-18T18:48:55.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6cdd2002-6d36-4afb-8e12-03691d17c278 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43602025-06-18T18:48:55.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6cdd2002-6d36-4afb-8e12-03691d17c278 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43612025-06-18T18:48:55.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2417 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6cdd2002-6d36-4afb-8e12-03691d17c278 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43622025-06-18T18:48:56.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 48a0706b-7602-4032-941c-7fbed472705c roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43632025-06-18T18:48:56.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 48a0706b-7602-4032-941c-7fbed472705c resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43642025-06-18T18:48:56.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2430 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 48a0706b-7602-4032-941c-7fbed472705c response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43652025-06-18T18:48:57.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
43662025-06-18T18:48:57.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
43672025-06-18T18:48:57.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43682025-06-18T18:48:57.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43692025-06-18T18:48:57.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43702025-06-18T18:48:57.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43712025-06-18T18:48:57.562ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43722025-06-18T18:48:57.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43732025-06-18T18:48:57.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43742025-06-18T18:48:57.563ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.238148ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43752025-06-18T18:48:57.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43762025-06-18T18:48:57.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43772025-06-18T18:48:57.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43782025-06-18T18:48:57.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43792025-06-18T18:48:57.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43802025-06-18T18:48:57.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43812025-06-18T18:48:57.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
43822025-06-18T18:48:57.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43832025-06-18T18:48:57.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43842025-06-18T18:48:57.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d7e8a3cf-ba1a-4c91-8b48-fb0025d6419d roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43852025-06-18T18:48:57.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d7e8a3cf-ba1a-4c91-8b48-fb0025d6419d resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43862025-06-18T18:48:57.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1936 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d7e8a3cf-ba1a-4c91-8b48-fb0025d6419d response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43872025-06-18T18:48:57.582ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
43882025-06-18T18:48:57.582ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.865235ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
43892025-06-18T18:48:58.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 99e7a659-9b43-49cd-a3d8-005444009fd0 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43902025-06-18T18:48:58.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 99e7a659-9b43-49cd-a3d8-005444009fd0 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43912025-06-18T18:48:58.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2223 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 99e7a659-9b43-49cd-a3d8-005444009fd0 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43922025-06-18T18:48:59.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = da4a242b-c334-4d8e-bfe8-8322cfd3554a roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43932025-06-18T18:48:59.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = da4a242b-c334-4d8e-bfe8-8322cfd3554a resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43942025-06-18T18:48:59.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2456 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = da4a242b-c334-4d8e-bfe8-8322cfd3554a response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43952025-06-18T18:49:00.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 052146cb-f8b6-499f-b274-ae0f6e6e67da roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43962025-06-18T18:49:00.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 052146cb-f8b6-499f-b274-ae0f6e6e67da resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43972025-06-18T18:49:00.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2674 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 052146cb-f8b6-499f-b274-ae0f6e6e67da response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
43982025-06-18T18:49:01.133ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 558 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 6c182906-022b-4a3b-98fe-54cc449fdb23 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
43992025-06-18T18:49:01.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3ceb98dc-3f4b-47e9-910f-25eaeb56ef0f roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44002025-06-18T18:49:01.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3ceb98dc-3f4b-47e9-910f-25eaeb56ef0f resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44012025-06-18T18:49:01.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2452 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3ceb98dc-3f4b-47e9-910f-25eaeb56ef0f response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44022025-06-18T18:49:02.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3acee562-7308-4f3d-ac5e-064c88e99bb2 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44032025-06-18T18:49:02.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3acee562-7308-4f3d-ac5e-064c88e99bb2 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44042025-06-18T18:49:02.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2206 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3acee562-7308-4f3d-ac5e-064c88e99bb2 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44052025-06-18T18:49:03.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 622ae9df-1090-4253-be35-459c9e38694f roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44062025-06-18T18:49:03.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 622ae9df-1090-4253-be35-459c9e38694f resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44072025-06-18T18:49:03.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2552 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 622ae9df-1090-4253-be35-459c9e38694f response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44082025-06-18T18:49:04.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 13e7e90f-a6eb-4b06-a72e-c40c10f4fbf5 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44092025-06-18T18:49:04.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 13e7e90f-a6eb-4b06-a72e-c40c10f4fbf5 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44102025-06-18T18:49:04.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2136 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 13e7e90f-a6eb-4b06-a72e-c40c10f4fbf5 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44112025-06-18T18:49:05.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9474da19-2ab1-4a57-9613-6c898575f0ed roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44122025-06-18T18:49:05.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9474da19-2ab1-4a57-9613-6c898575f0ed resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44132025-06-18T18:49:05.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2480 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9474da19-2ab1-4a57-9613-6c898575f0ed response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44142025-06-18T18:49:06.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = defd5250-7830-40ef-a01b-307a90e1818e roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44152025-06-18T18:49:06.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = defd5250-7830-40ef-a01b-307a90e1818e resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44162025-06-18T18:49:06.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2022 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = defd5250-7830-40ef-a01b-307a90e1818e response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44172025-06-18T18:49:07.559ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
44182025-06-18T18:49:07.559ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44192025-06-18T18:49:07.559ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
44202025-06-18T18:49:07.559ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44212025-06-18T18:49:07.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44222025-06-18T18:49:07.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44232025-06-18T18:49:07.562ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44242025-06-18T18:49:07.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44252025-06-18T18:49:07.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44262025-06-18T18:49:07.564ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.895357ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44272025-06-18T18:49:07.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44282025-06-18T18:49:07.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44292025-06-18T18:49:07.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44302025-06-18T18:49:07.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44312025-06-18T18:49:07.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44322025-06-18T18:49:07.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44332025-06-18T18:49:07.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
44342025-06-18T18:49:07.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44352025-06-18T18:49:07.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44362025-06-18T18:49:07.583ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
44372025-06-18T18:49:07.583ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.372447ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
44382025-06-18T18:49:07.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 62c941f4-ed38-4292-a0a1-d9f9a7dc9d7d roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44392025-06-18T18:49:07.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 62c941f4-ed38-4292-a0a1-d9f9a7dc9d7d resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44402025-06-18T18:49:07.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1967 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 62c941f4-ed38-4292-a0a1-d9f9a7dc9d7d response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44412025-06-18T18:49:08.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 342a5de5-0de7-42ee-8d85-b1fe0a788eaf roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44422025-06-18T18:49:08.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 342a5de5-0de7-42ee-8d85-b1fe0a788eaf resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44432025-06-18T18:49:08.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2445 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 342a5de5-0de7-42ee-8d85-b1fe0a788eaf response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44442025-06-18T18:49:09.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 761837f9-9371-4393-82df-5b587e15938d roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44452025-06-18T18:49:09.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 761837f9-9371-4393-82df-5b587e15938d resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44462025-06-18T18:49:09.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2503 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 761837f9-9371-4393-82df-5b587e15938d response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44472025-06-18T18:49:10.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3c857a67-d2ad-4d32-9d78-a76a4cca1dac roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44482025-06-18T18:49:10.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3c857a67-d2ad-4d32-9d78-a76a4cca1dac resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44492025-06-18T18:49:10.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2736 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3c857a67-d2ad-4d32-9d78-a76a4cca1dac response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44502025-06-18T18:49:11.134ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 660 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 2282cb92-6e8f-4054-8fdc-73384227c367 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
44512025-06-18T18:49:11.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 584e6a16-4833-491a-b4d3-dfc525749ae4 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44522025-06-18T18:49:11.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 584e6a16-4833-491a-b4d3-dfc525749ae4 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44532025-06-18T18:49:11.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2307 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 584e6a16-4833-491a-b4d3-dfc525749ae4 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44542025-06-18T18:49:12.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c314234b-ee71-4229-b8f6-be4d1b96d322 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44552025-06-18T18:49:12.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c314234b-ee71-4229-b8f6-be4d1b96d322 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44562025-06-18T18:49:12.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2305 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c314234b-ee71-4229-b8f6-be4d1b96d322 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44572025-06-18T18:49:13.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5e35159f-39de-4770-85f0-21798269d4e9 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44582025-06-18T18:49:13.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5e35159f-39de-4770-85f0-21798269d4e9 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44592025-06-18T18:49:13.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2495 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5e35159f-39de-4770-85f0-21798269d4e9 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44602025-06-18T18:49:14.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 86bf2e1b-5283-413c-ae7f-66d4abc4696b roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44612025-06-18T18:49:14.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 86bf2e1b-5283-413c-ae7f-66d4abc4696b resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44622025-06-18T18:49:14.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2394 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 86bf2e1b-5283-413c-ae7f-66d4abc4696b response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44632025-06-18T18:49:15.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 85342549-488e-4580-8174-6f20106a6e16 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44642025-06-18T18:49:15.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 85342549-488e-4580-8174-6f20106a6e16 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44652025-06-18T18:49:15.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1791 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 85342549-488e-4580-8174-6f20106a6e16 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44662025-06-18T18:49:16.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 516cd4e0-420f-4947-8d2d-f9657fd36660 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44672025-06-18T18:49:16.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 516cd4e0-420f-4947-8d2d-f9657fd36660 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44682025-06-18T18:49:16.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2551 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 516cd4e0-420f-4947-8d2d-f9657fd36660 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
44692025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
44702025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44712025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
44722025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
44732025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44742025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
44752025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44762025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
44772025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44782025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
44792025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44802025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
44812025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 28 reason = Timeout
44822025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44832025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
44842025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
44852025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
44862025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
44872025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44882025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
44892025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44902025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
44912025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
44922025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
44932025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
44942025-06-18T18:49:17.560ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
44952025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44962025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44972025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
44982025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44992025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
45002025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
45012025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 28 reason = Timeout
45022025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45032025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
45042025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
45052025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
45062025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
45072025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45082025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45092025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45102025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45112025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45122025-06-18T18:49:17.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45132025-06-18T18:49:17.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
45142025-06-18T18:49:17.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45152025-06-18T18:49:17.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
45162025-06-18T18:49:17.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
45172025-06-18T18:49:17.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45182025-06-18T18:49:17.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45192025-06-18T18:49:17.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
45202025-06-18T18:49:17.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45212025-06-18T18:49:17.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45222025-06-18T18:49:17.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45232025-06-18T18:49:17.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45242025-06-18T18:49:17.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45252025-06-18T18:49:17.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
45262025-06-18T18:49:17.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45272025-06-18T18:49:17.564ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1747, tv_nsec: 143668139 } })
45282025-06-18T18:49:17.564ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45292025-06-18T18:49:17.565ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
45302025-06-18T18:49:17.565ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.388191ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
45312025-06-18T18:49:17.566ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45322025-06-18T18:49:17.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45332025-06-18T18:49:17.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45342025-06-18T18:49:17.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45352025-06-18T18:49:17.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
45362025-06-18T18:49:17.568ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45372025-06-18T18:49:17.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45382025-06-18T18:49:17.569ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45392025-06-18T18:49:17.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
45402025-06-18T18:49:17.569ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
45412025-06-18T18:49:17.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
45422025-06-18T18:49:17.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45432025-06-18T18:49:17.569ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.041125ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
45442025-06-18T18:49:17.570ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45452025-06-18T18:49:17.571ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45462025-06-18T18:49:17.571ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1747, tv_nsec: 150395682 } })
45472025-06-18T18:49:17.571ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45482025-06-18T18:49:17.571ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
45492025-06-18T18:49:17.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45502025-06-18T18:49:17.571ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45512025-06-18T18:49:17.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45522025-06-18T18:49:17.573ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45532025-06-18T18:49:17.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45542025-06-18T18:49:17.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
45552025-06-18T18:49:17.574ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45562025-06-18T18:49:17.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45572025-06-18T18:49:17.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
45582025-06-18T18:49:17.575ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45592025-06-18T18:49:17.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45602025-06-18T18:49:17.577ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45612025-06-18T18:49:17.578ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 17.489201ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
45622025-06-18T18:49:17.579ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45632025-06-18T18:49:17.579ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45642025-06-18T18:49:17.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45652025-06-18T18:49:17.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45662025-06-18T18:49:17.579ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1747, tv_nsec: 158727347 } })
45672025-06-18T18:49:17.579ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
45682025-06-18T18:49:17.580ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45692025-06-18T18:49:17.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45702025-06-18T18:49:17.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45712025-06-18T18:49:17.581ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45722025-06-18T18:49:17.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45732025-06-18T18:49:17.582ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45742025-06-18T18:49:17.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45752025-06-18T18:49:17.583ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45762025-06-18T18:49:17.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45772025-06-18T18:49:17.585ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45782025-06-18T18:49:17.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45792025-06-18T18:49:17.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45802025-06-18T18:49:17.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
45812025-06-18T18:49:17.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45822025-06-18T18:49:17.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45832025-06-18T18:49:17.600ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
45842025-06-18T18:49:17.600ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 40.356237ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
45852025-06-18T18:49:17.610ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45862025-06-18T18:49:17.610ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
45872025-06-18T18:49:17.610ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45882025-06-18T18:49:17.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45892025-06-18T18:49:17.616ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45902025-06-18T18:49:17.616ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
45912025-06-18T18:49:17.616ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45922025-06-18T18:49:17.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45932025-06-18T18:49:17.618ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45942025-06-18T18:49:17.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45952025-06-18T18:49:17.621ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.459058ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45962025-06-18T18:49:17.624ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45972025-06-18T18:49:17.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45982025-06-18T18:49:17.624ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 64.222836ms iteration = 28 status = {"errors":[],"requests_created_ok":[]}
45992025-06-18T18:49:17.625ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46002025-06-18T18:49:17.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46012025-06-18T18:49:17.626ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46022025-06-18T18:49:17.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46032025-06-18T18:49:17.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 66.849092ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
46042025-06-18T18:49:17.627ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
46052025-06-18T18:49:17.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46062025-06-18T18:49:17.628ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46072025-06-18T18:49:17.629ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46082025-06-18T18:49:17.629ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
46092025-06-18T18:49:17.629ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 69.022433ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
46102025-06-18T18:49:17.630ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 69.624741ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
46112025-06-18T18:49:17.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9fbbc826-5b83-4b80-8172-66302c618aae, lookup_type: ById(9fbbc826-5b83-4b80-8172-66302c618aae) } result = Ok(())
46122025-06-18T18:49:17.631ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46132025-06-18T18:49:17.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46142025-06-18T18:49:17.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
46152025-06-18T18:49:17.632ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
46162025-06-18T18:49:17.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46172025-06-18T18:49:17.638ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46182025-06-18T18:49:17.640ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 79.516547ms iteration = 28 status = 0
46192025-06-18T18:49:17.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46202025-06-18T18:49:17.642ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46212025-06-18T18:49:17.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46222025-06-18T18:49:17.642ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
46232025-06-18T18:49:17.642ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46242025-06-18T18:49:17.643ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "be704404-6e6a-4470-b18a-866177b68489", "content-length": "26", "date": "Wed, 18 Jun 2025 18:49:17 GMT"} })
46252025-06-18T18:49:17.643ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46262025-06-18T18:49:17.645ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46272025-06-18T18:49:17.657ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
46282025-06-18T18:49:17.657ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46292025-06-18T18:49:17.657ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "34852f98-d3be-4f59-928a-31fc7ef74934", "content-length": "26", "date": "Wed, 18 Jun 2025 18:49:17 GMT"} })
46302025-06-18T18:49:17.657ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46312025-06-18T18:49:17.659ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46322025-06-18T18:49:17.660ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46332025-06-18T18:49:17.660ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
46342025-06-18T18:49:17.660ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 99.940598ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
46352025-06-18T18:49:17.662ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f zone_address = fd00:1122:3344:101::2
46362025-06-18T18:49:17.662ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46372025-06-18T18:49:17.662ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "82d09a49-5e13-4d4a-8b39-64f6b08e102a", "content-length": "26", "date": "Wed, 18 Jun 2025 18:49:17 GMT"} })
46382025-06-18T18:49:17.662ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46392025-06-18T18:49:17.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 104.123677ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
46402025-06-18T18:49:17.664ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
46412025-06-18T18:49:17.673ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
46422025-06-18T18:49:17.673ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 112.700024ms iteration = 28 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
46432025-06-18T18:49:17.692ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46442025-06-18T18:49:17.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46452025-06-18T18:49:17.744ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 184.049899ms iteration = 31 status = {"physical_disks_added":0}
46462025-06-18T18:49:17.791ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
46472025-06-18T18:49:17.791ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46482025-06-18T18:49:17.791ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c3f6173-10b5-49ad-b7f4-b109b53df8b8", "content-length": "372", "date": "Wed, 18 Jun 2025 18:49:17 GMT"} })
46492025-06-18T18:49:17.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46502025-06-18T18:49:17.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46512025-06-18T18:49:17.793ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46522025-06-18T18:49:17.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46532025-06-18T18:49:17.794ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46542025-06-18T18:49:17.797ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46552025-06-18T18:49:17.797ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46562025-06-18T18:49:17.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46572025-06-18T18:49:17.798ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46582025-06-18T18:49:17.800ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46592025-06-18T18:49:17.800ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46602025-06-18T18:49:17.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46612025-06-18T18:49:17.806ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
46622025-06-18T18:49:17.806ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
46632025-06-18T18:49:17.806ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a3da8254-4ece-43ab-9207-007c26fcc289", "date": "Wed, 18 Jun 2025 18:49:17 GMT"} })
46642025-06-18T18:49:17.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46652025-06-18T18:49:17.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46662025-06-18T18:49:17.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46672025-06-18T18:49:17.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46682025-06-18T18:49:17.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46692025-06-18T18:49:17.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46702025-06-18T18:49:17.815ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
46712025-06-18T18:49:17.815ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46722025-06-18T18:49:17.815ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "64c7558c-1fc2-4c5e-8769-cdffb623b99a", "date": "Wed, 18 Jun 2025 18:49:17 GMT"} })
46732025-06-18T18:49:17.816ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 256.153634ms iteration = 29 status = {}
46742025-06-18T18:49:17.843ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46752025-06-18T18:49:17.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46762025-06-18T18:49:17.845ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 284.949241ms iteration = 28 status = null
46772025-06-18T18:49:17.857ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 297.460113ms iteration = 28 status = {}
46782025-06-18T18:49:17.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 38cb454c-2bfa-4fea-a652-14787e2d0ca1 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
46792025-06-18T18:49:17.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 38cb454c-2bfa-4fea-a652-14787e2d0ca1 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
46802025-06-18T18:49:17.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2417 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 38cb454c-2bfa-4fea-a652-14787e2d0ca1 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
46812025-06-18T18:49:17.917ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46822025-06-18T18:49:17.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46832025-06-18T18:49:17.920ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 7e1ff921-047f-464e-8081-f8132af716ac, rack_id: 3a330d2e-6212-46a4-9781-374fdb3dc92f, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(6c07c314-d66b-4041-9040-d774200d26a9) } rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
46842025-06-18T18:49:17.920ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46852025-06-18T18:49:17.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46862025-06-18T18:49:17.923ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46872025-06-18T18:49:17.923ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9376b9ba-a961-40ac-9574-e503e74b180b", "content-length": "691", "date": "Wed, 18 Jun 2025 18:49:17 GMT"} })
46882025-06-18T18:49:17.923ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
46892025-06-18T18:49:17.923ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
46902025-06-18T18:49:17.923ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
46912025-06-18T18:49:17.926ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 365.800427ms iteration = 29 status = {}
46922025-06-18T18:49:17.932ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
46932025-06-18T18:49:17.932ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 6c07c314-d66b-4041-9040-d774200d26a9
46942025-06-18T18:49:17.933ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
46952025-06-18T18:49:17.933ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46962025-06-18T18:49:17.933ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46972025-06-18T18:49:17.933ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46982025-06-18T18:49:17.933ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46992025-06-18T18:49:17.933ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47002025-06-18T18:49:17.933ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47012025-06-18T18:49:17.933ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47022025-06-18T18:49:17.933ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
47032025-06-18T18:49:17.933ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47042025-06-18T18:49:17.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47052025-06-18T18:49:17.935ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
47062025-06-18T18:49:17.935ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
47072025-06-18T18:49:18.037ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "016a18a4-ad7d-42df-82b2-d895c8204f5c", "date": "Wed, 18 Jun 2025 18:49:17 GMT"} })
47082025-06-18T18:49:18.037ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch = Switch0
47092025-06-18T18:49:18.037ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
47102025-06-18T18:49:18.037ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "65d7ce21-b788-4dea-bcc0-72abefae9f7d", "content-length": "682", "date": "Wed, 18 Jun 2025 18:49:17 GMT"} })
47112025-06-18T18:49:18.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47122025-06-18T18:49:18.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47132025-06-18T18:49:18.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47142025-06-18T18:49:18.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47152025-06-18T18:49:18.045ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47162025-06-18T18:49:18.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47172025-06-18T18:49:18.047ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47182025-06-18T18:49:18.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47192025-06-18T18:49:18.054ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 494.657184ms iteration = 28 status = {}
47202025-06-18T18:49:18.666ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 5
47212025-06-18T18:49:18.666ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221
47222025-06-18T18:49:18.695ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
47232025-06-18T18:49:18.695ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:40685
47242025-06-18T18:49:18.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:40685 req_id = 2cd26757-96c5-4558-815a-598d44010c8b roles = RoleSet { roles: {} } uri = /metrics/producers
47252025-06-18T18:49:18.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:40685 req_id = 2cd26757-96c5-4558-815a-598d44010c8b resource = Database result = Ok(()) uri = /metrics/producers
47262025-06-18T18:49:18.742ZINFOnexus: assigned collector to new producer collector_id = c88bda47-97a6-468e-bf39-3fffe994d639 file = nexus/src/app/oximeter.rs:76 producer_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
47272025-06-18T18:49:18.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 46015 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:40685 req_id = 2cd26757-96c5-4558-815a-598d44010c8b response_code = 201 uri = /metrics/producers
47282025-06-18T18:49:18.742ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "2cd26757-96c5-4558-815a-598d44010c8b", "content-length": "41", "date": "Wed, 18 Jun 2025 18:49:18 GMT"} })
47292025-06-18T18:49:18.744ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
47302025-06-18T18:49:18.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7c82f67a-04ac-4c87-9117-68065008c222 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47312025-06-18T18:49:18.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7c82f67a-04ac-4c87-9117-68065008c222 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47322025-06-18T18:49:18.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2528 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7c82f67a-04ac-4c87-9117-68065008c222 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47332025-06-18T18:49:19.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4d1dfa1f-7e0f-4739-b852-9539a9a72faa roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47342025-06-18T18:49:19.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4d1dfa1f-7e0f-4739-b852-9539a9a72faa resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47352025-06-18T18:49:19.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2122 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4d1dfa1f-7e0f-4739-b852-9539a9a72faa response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47362025-06-18T18:49:20.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 2b3a0b4f-a355-4735-b1b1-bb1ec3291ea8 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47372025-06-18T18:49:20.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 2b3a0b4f-a355-4735-b1b1-bb1ec3291ea8 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47382025-06-18T18:49:20.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3052 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 2b3a0b4f-a355-4735-b1b1-bb1ec3291ea8 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47392025-06-18T18:49:21.134ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 559 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 9b9d7f60-63f5-47c7-ac6c-c4430aea1e2a response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
47402025-06-18T18:49:21.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e459ee22-f4df-4aa6-8af3-44aba74de4f2 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47412025-06-18T18:49:21.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e459ee22-f4df-4aa6-8af3-44aba74de4f2 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47422025-06-18T18:49:21.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2874 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e459ee22-f4df-4aa6-8af3-44aba74de4f2 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47432025-06-18T18:49:22.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6436c2a3-8e8d-491c-8042-284a7e4d9633 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47442025-06-18T18:49:22.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6436c2a3-8e8d-491c-8042-284a7e4d9633 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47452025-06-18T18:49:22.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2473 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6436c2a3-8e8d-491c-8042-284a7e4d9633 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47462025-06-18T18:49:23.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e6ce320a-0768-461e-896b-0d02ef49300b roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47472025-06-18T18:49:23.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e6ce320a-0768-461e-896b-0d02ef49300b resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47482025-06-18T18:49:23.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2881 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e6ce320a-0768-461e-896b-0d02ef49300b response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47492025-06-18T18:49:25.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7ed1a459-5ad9-4edc-80fe-6542932079a1 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47502025-06-18T18:49:25.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7ed1a459-5ad9-4edc-80fe-6542932079a1 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47512025-06-18T18:49:25.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2691 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7ed1a459-5ad9-4edc-80fe-6542932079a1 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47522025-06-18T18:49:26.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c7d87a42-249a-4fda-b403-c1f844a178a5 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47532025-06-18T18:49:26.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c7d87a42-249a-4fda-b403-c1f844a178a5 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47542025-06-18T18:49:26.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2405 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c7d87a42-249a-4fda-b403-c1f844a178a5 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47552025-06-18T18:49:27.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b5750a8e-59af-46a0-9f02-3449c75734a8 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47562025-06-18T18:49:27.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b5750a8e-59af-46a0-9f02-3449c75734a8 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47572025-06-18T18:49:27.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2448 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b5750a8e-59af-46a0-9f02-3449c75734a8 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47582025-06-18T18:49:27.560ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
47592025-06-18T18:49:27.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47602025-06-18T18:49:27.560ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
47612025-06-18T18:49:27.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47622025-06-18T18:49:27.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47632025-06-18T18:49:27.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47642025-06-18T18:49:27.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47652025-06-18T18:49:27.563ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47662025-06-18T18:49:27.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47672025-06-18T18:49:27.565ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47682025-06-18T18:49:27.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47692025-06-18T18:49:27.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47702025-06-18T18:49:27.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47712025-06-18T18:49:27.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47722025-06-18T18:49:27.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47732025-06-18T18:49:27.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
47742025-06-18T18:49:27.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47752025-06-18T18:49:27.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47762025-06-18T18:49:27.586ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
47772025-06-18T18:49:27.587ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.938462ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
47782025-06-18T18:49:27.602ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 42.252913ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47792025-06-18T18:49:28.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4dc415d6-1d5c-4b50-ac62-0c612d6cdd87 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47802025-06-18T18:49:28.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4dc415d6-1d5c-4b50-ac62-0c612d6cdd87 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47812025-06-18T18:49:28.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2095 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4dc415d6-1d5c-4b50-ac62-0c612d6cdd87 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47822025-06-18T18:49:29.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = abe59999-8644-4346-961d-848e9a203718 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47832025-06-18T18:49:29.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = abe59999-8644-4346-961d-848e9a203718 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47842025-06-18T18:49:29.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2478 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = abe59999-8644-4346-961d-848e9a203718 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47852025-06-18T18:49:30.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a6e3aa1c-d0e5-4fbe-8402-057208e4faa5 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47862025-06-18T18:49:30.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a6e3aa1c-d0e5-4fbe-8402-057208e4faa5 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47872025-06-18T18:49:30.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2410 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a6e3aa1c-d0e5-4fbe-8402-057208e4faa5 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47882025-06-18T18:49:31.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a6acc772-01d6-4842-89d1-5af6e08eb919 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47892025-06-18T18:49:31.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a6acc772-01d6-4842-89d1-5af6e08eb919 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47902025-06-18T18:49:31.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2522 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a6acc772-01d6-4842-89d1-5af6e08eb919 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47912025-06-18T18:49:31.134ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 554 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = bc5f1743-b9f8-4483-8caf-0230c3117f62 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
47922025-06-18T18:49:32.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 78231e70-1035-42aa-b828-89f38529c91d roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47932025-06-18T18:49:32.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 78231e70-1035-42aa-b828-89f38529c91d resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47942025-06-18T18:49:32.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2496 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 78231e70-1035-42aa-b828-89f38529c91d response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47952025-06-18T18:49:33.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 11dc286b-4dff-4af0-abac-f757bbfd7e1b roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47962025-06-18T18:49:33.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 11dc286b-4dff-4af0-abac-f757bbfd7e1b resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47972025-06-18T18:49:33.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2708 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 11dc286b-4dff-4af0-abac-f757bbfd7e1b response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47982025-06-18T18:49:34.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 67a3c171-f6f0-4a65-b852-1374a6e49346 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
47992025-06-18T18:49:34.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 67a3c171-f6f0-4a65-b852-1374a6e49346 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48002025-06-18T18:49:34.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2771 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 67a3c171-f6f0-4a65-b852-1374a6e49346 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48012025-06-18T18:49:35.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d5cf296e-3ed7-46ed-8665-f70116a5f3bb roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48022025-06-18T18:49:35.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d5cf296e-3ed7-46ed-8665-f70116a5f3bb resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48032025-06-18T18:49:35.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2024 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d5cf296e-3ed7-46ed-8665-f70116a5f3bb response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48042025-06-18T18:49:36.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 66b63409-aabe-4e4b-9b4c-cdca32b0be4e roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48052025-06-18T18:49:36.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 66b63409-aabe-4e4b-9b4c-cdca32b0be4e resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48062025-06-18T18:49:36.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2702 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 66b63409-aabe-4e4b-9b4c-cdca32b0be4e response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48072025-06-18T18:49:37.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cf8e81b6-cd31-4085-b624-2de702a5b870 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48082025-06-18T18:49:37.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cf8e81b6-cd31-4085-b624-2de702a5b870 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48092025-06-18T18:49:37.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2071 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cf8e81b6-cd31-4085-b624-2de702a5b870 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48102025-06-18T18:49:37.560ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
48112025-06-18T18:49:37.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48122025-06-18T18:49:37.560ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
48132025-06-18T18:49:37.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48142025-06-18T18:49:37.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48152025-06-18T18:49:37.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48162025-06-18T18:49:37.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48172025-06-18T18:49:37.563ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48182025-06-18T18:49:37.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48192025-06-18T18:49:37.565ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.556943ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48202025-06-18T18:49:37.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48212025-06-18T18:49:37.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48222025-06-18T18:49:37.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48232025-06-18T18:49:37.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48242025-06-18T18:49:37.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48252025-06-18T18:49:37.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48262025-06-18T18:49:37.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
48272025-06-18T18:49:37.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48282025-06-18T18:49:37.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48292025-06-18T18:49:37.580ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
48302025-06-18T18:49:37.581ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.132858ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
48312025-06-18T18:49:38.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5c84661c-b77c-4a12-a9d7-b33126175065 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48322025-06-18T18:49:38.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5c84661c-b77c-4a12-a9d7-b33126175065 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48332025-06-18T18:49:38.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2315 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5c84661c-b77c-4a12-a9d7-b33126175065 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48342025-06-18T18:49:39.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9d1c1d03-3499-4603-b426-e6dd6e310feb roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48352025-06-18T18:49:39.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9d1c1d03-3499-4603-b426-e6dd6e310feb resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48362025-06-18T18:49:39.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2613 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9d1c1d03-3499-4603-b426-e6dd6e310feb response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48372025-06-18T18:49:40.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c0bc781e-e1ab-4764-807e-71255f0c9edf roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48382025-06-18T18:49:40.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c0bc781e-e1ab-4764-807e-71255f0c9edf resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48392025-06-18T18:49:40.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2291 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c0bc781e-e1ab-4764-807e-71255f0c9edf response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48402025-06-18T18:49:41.135ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 968 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 6335782f-47d7-4ccc-963d-b6e5148fadf7 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
48412025-06-18T18:49:41.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 64550b91-8b85-444f-8bc9-f080b8b10cf6 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48422025-06-18T18:49:41.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 64550b91-8b85-444f-8bc9-f080b8b10cf6 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48432025-06-18T18:49:41.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2038 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 64550b91-8b85-444f-8bc9-f080b8b10cf6 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48442025-06-18T18:49:42.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 53343ff7-c663-42d6-814b-278cb5f685a7 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48452025-06-18T18:49:42.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 53343ff7-c663-42d6-814b-278cb5f685a7 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48462025-06-18T18:49:42.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2862 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 53343ff7-c663-42d6-814b-278cb5f685a7 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48472025-06-18T18:49:43.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0599afc7-ba6e-407f-84c0-db13125d76fc roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48482025-06-18T18:49:43.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0599afc7-ba6e-407f-84c0-db13125d76fc resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48492025-06-18T18:49:43.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3120 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0599afc7-ba6e-407f-84c0-db13125d76fc response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48502025-06-18T18:49:44.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 127d68a6-acaa-43dd-9757-d97f505c95d3 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48512025-06-18T18:49:44.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 127d68a6-acaa-43dd-9757-d97f505c95d3 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48522025-06-18T18:49:44.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2656 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 127d68a6-acaa-43dd-9757-d97f505c95d3 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48532025-06-18T18:49:45.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8e6f14ed-9cc1-4063-b854-eee091cfeea6 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48542025-06-18T18:49:45.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8e6f14ed-9cc1-4063-b854-eee091cfeea6 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48552025-06-18T18:49:45.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2290 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8e6f14ed-9cc1-4063-b854-eee091cfeea6 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48562025-06-18T18:49:46.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bcc7471e-c060-4844-8a0e-a79b66640bd4 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48572025-06-18T18:49:46.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bcc7471e-c060-4844-8a0e-a79b66640bd4 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48582025-06-18T18:49:46.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2095 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bcc7471e-c060-4844-8a0e-a79b66640bd4 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48592025-06-18T18:49:47.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5e749559-e929-4e97-8cc7-0805e644da58 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48602025-06-18T18:49:47.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5e749559-e929-4e97-8cc7-0805e644da58 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48612025-06-18T18:49:47.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2892 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5e749559-e929-4e97-8cc7-0805e644da58 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
48622025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
48632025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
48642025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48652025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 15 reason = Timeout
48662025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
48672025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
48682025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
48692025-06-18T18:49:47.561ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-18 18:39:47.561082286 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
48702025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
48712025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
48722025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
48732025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48742025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
48752025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
48762025-06-18T18:49:47.561ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe
48772025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.58\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe"}
48782025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
48792025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
48802025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
48812025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48822025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48832025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
48842025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48852025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
48862025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
48872025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48882025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48892025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
48902025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
48912025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
48922025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
48932025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
48942025-06-18T18:49:47.561ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
48952025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
48962025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48972025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 29 reason = Timeout
48982025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
48992025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
49002025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49012025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
49022025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 15 reason = Timeout
49032025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
49042025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49052025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
49062025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49072025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
49082025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
49092025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49102025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
49112025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
49122025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49132025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
49142025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
49152025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
49162025-06-18T18:49:47.561ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
49172025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
49182025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 29 reason = Timeout
49192025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
49202025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
49212025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49222025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
49232025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49242025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
49252025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
49262025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
49272025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49282025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
49292025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
49302025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
49312025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
49322025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49332025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
49342025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
49352025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
49362025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49372025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49382025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49392025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49402025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49412025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
49422025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49432025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49442025-06-18T18:49:47.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49452025-06-18T18:49:47.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49462025-06-18T18:49:47.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49472025-06-18T18:49:47.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
49482025-06-18T18:49:47.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49492025-06-18T18:49:47.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49502025-06-18T18:49:47.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
49512025-06-18T18:49:47.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
49522025-06-18T18:49:47.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49532025-06-18T18:49:47.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
49542025-06-18T18:49:47.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
49552025-06-18T18:49:47.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
49562025-06-18T18:49:47.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
49572025-06-18T18:49:47.562ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("03fce462-e4e1-4a86-890b-8a2ae9e17168.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("800703b5-0601-4ce2-acc3-d5b9ca473160.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("800703b5-0601-4ce2-acc3-d5b9ca473160.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1777, tv_nsec: 140669582 } })
49582025-06-18T18:49:47.562ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("51411444-5ad0-46e8-b345-7ee26fb32a60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("adea75c9-2ff2-4f9f-bfac-48c7702333e0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea7c6eed-68db-4cd0-929a-17b08777d263.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea7c6eed-68db-4cd0-929a-17b08777d263.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1777, tv_nsec: 140667282 } })
49592025-06-18T18:49:47.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
49602025-06-18T18:49:47.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49612025-06-18T18:49:47.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49622025-06-18T18:49:47.562ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
49632025-06-18T18:49:47.562ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
49642025-06-18T18:49:47.562ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.594642ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
49652025-06-18T18:49:47.562ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.542532ms iteration = 15 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
49662025-06-18T18:49:47.566ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49672025-06-18T18:49:47.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49682025-06-18T18:49:47.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49692025-06-18T18:49:47.569ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49702025-06-18T18:49:47.570ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-18 18:39:47.561082286 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
49712025-06-18T18:49:47.570ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.43862ms iteration = 15 status = {"expiration":"2025-06-18T18:39:47.561082286Z","pruned":[]}
49722025-06-18T18:49:47.571ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 10.11304ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49732025-06-18T18:49:47.571ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49742025-06-18T18:49:47.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49752025-06-18T18:49:47.572ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49762025-06-18T18:49:47.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49772025-06-18T18:49:47.572ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1777, tv_nsec: 151495731 } })
49782025-06-18T18:49:47.573ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
49792025-06-18T18:49:47.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49802025-06-18T18:49:47.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49812025-06-18T18:49:47.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49822025-06-18T18:49:47.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
49832025-06-18T18:49:47.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49842025-06-18T18:49:47.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49852025-06-18T18:49:47.578ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49862025-06-18T18:49:47.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49872025-06-18T18:49:47.578ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49882025-06-18T18:49:47.580ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
49892025-06-18T18:49:47.580ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 19.58519ms iteration = 15 status = {"by_rx":{},"error":null}
49902025-06-18T18:49:47.581ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49912025-06-18T18:49:47.582ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
49922025-06-18T18:49:47.582ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49932025-06-18T18:49:47.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49942025-06-18T18:49:47.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
49952025-06-18T18:49:47.584ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
49962025-06-18T18:49:47.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
49972025-06-18T18:49:47.587ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 25.647254ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
49982025-06-18T18:49:47.588ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1777, tv_nsec: 166710141 } })
49992025-06-18T18:49:47.588ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
50002025-06-18T18:49:47.590ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50012025-06-18T18:49:47.590ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
50022025-06-18T18:49:47.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
50032025-06-18T18:49:47.591ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50042025-06-18T18:49:47.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50052025-06-18T18:49:47.595ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 33.613174ms iteration = 15 status = {"dispatched":[],"errors":[],"glob_version":"150.0.0","globs_reprocessed":{},"no_receivers":[]}
50062025-06-18T18:49:47.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50072025-06-18T18:49:47.600ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1777, tv_nsec: 179169823 } })
50082025-06-18T18:49:47.600ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
50092025-06-18T18:49:47.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50102025-06-18T18:49:47.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50112025-06-18T18:49:47.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50122025-06-18T18:49:47.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50132025-06-18T18:49:47.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50142025-06-18T18:49:47.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50152025-06-18T18:49:47.615ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50162025-06-18T18:49:47.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50172025-06-18T18:49:47.617ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50182025-06-18T18:49:47.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50192025-06-18T18:49:47.619ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50202025-06-18T18:49:47.622ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.286735ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
50212025-06-18T18:49:47.622ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50222025-06-18T18:49:47.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
50232025-06-18T18:49:47.624ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50242025-06-18T18:49:47.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50252025-06-18T18:49:47.624ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50262025-06-18T18:49:47.627ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50272025-06-18T18:49:47.627ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50282025-06-18T18:49:47.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50292025-06-18T18:49:47.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
50302025-06-18T18:49:47.629ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
50312025-06-18T18:49:47.629ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50322025-06-18T18:49:47.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
50332025-06-18T18:49:47.630ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.59913ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50342025-06-18T18:49:47.631ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50352025-06-18T18:49:47.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50362025-06-18T18:49:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
50372025-06-18T18:49:47.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50382025-06-18T18:49:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50392025-06-18T18:49:47.633ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 71.846781ms iteration = 29 status = {"errors":[],"finish_invoked_ok":[]}
50402025-06-18T18:49:47.635ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
50412025-06-18T18:49:47.635ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
50422025-06-18T18:49:47.635ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 73.986461ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
50432025-06-18T18:49:47.640ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50442025-06-18T18:49:47.643ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50452025-06-18T18:49:47.644ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50462025-06-18T18:49:47.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50472025-06-18T18:49:47.652ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50482025-06-18T18:49:47.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50492025-06-18T18:49:47.653ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 91.817187ms iteration = 29 status = {"errors":[],"requests_created_ok":[]}
50502025-06-18T18:49:47.653ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50512025-06-18T18:49:47.653ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
50522025-06-18T18:49:47.653ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50532025-06-18T18:49:47.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50542025-06-18T18:49:47.656ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
50552025-06-18T18:49:47.656ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
50562025-06-18T18:49:47.656ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
50572025-06-18T18:49:47.656ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50582025-06-18T18:49:47.656ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50592025-06-18T18:49:47.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50602025-06-18T18:49:47.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50612025-06-18T18:49:47.658ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50622025-06-18T18:49:47.660ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
50632025-06-18T18:49:47.660ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50642025-06-18T18:49:47.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50652025-06-18T18:49:47.662ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50662025-06-18T18:49:47.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50672025-06-18T18:49:47.666ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50682025-06-18T18:49:47.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50692025-06-18T18:49:47.670ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
50702025-06-18T18:49:47.670ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 109.571811ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
50712025-06-18T18:49:47.671ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50722025-06-18T18:49:47.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50732025-06-18T18:49:47.672ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
50742025-06-18T18:49:47.672ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
50752025-06-18T18:49:47.672ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
50762025-06-18T18:49:47.672ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50772025-06-18T18:49:47.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50782025-06-18T18:49:47.680ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
50792025-06-18T18:49:47.681ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
50802025-06-18T18:49:47.681ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 119.58192ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
50812025-06-18T18:49:47.683ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
50822025-06-18T18:49:47.688ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 127.5763ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
50832025-06-18T18:49:47.694ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
50842025-06-18T18:49:47.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
50852025-06-18T18:49:47.699ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 138.383759ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
50862025-06-18T18:49:47.701ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
50872025-06-18T18:49:47.701ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 140.121743ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
50882025-06-18T18:49:47.713ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
50892025-06-18T18:49:47.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
50902025-06-18T18:49:47.724ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50912025-06-18T18:49:47.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50922025-06-18T18:49:47.740ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
50932025-06-18T18:49:47.740ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50942025-06-18T18:49:47.741ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "62ee1dd9-ab16-4977-96fe-bfab702149b1", "content-length": "26", "date": "Wed, 18 Jun 2025 18:49:47 GMT"} })
50952025-06-18T18:49:47.741ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50962025-06-18T18:49:47.743ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50972025-06-18T18:49:47.756ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
50982025-06-18T18:49:47.756ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50992025-06-18T18:49:47.757ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bb8dc83-cf89-4f46-a14b-3eaed65c70db", "content-length": "26", "date": "Wed, 18 Jun 2025 18:49:47 GMT"} })
51002025-06-18T18:49:47.757ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51012025-06-18T18:49:47.758ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51022025-06-18T18:49:47.782ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
51032025-06-18T18:49:47.827ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
51042025-06-18T18:49:47.827ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51052025-06-18T18:49:47.827ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdc8714a-f05c-48f8-bbbd-dbf4aaeebc99", "content-length": "372", "date": "Wed, 18 Jun 2025 18:49:47 GMT"} })
51062025-06-18T18:49:47.827ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51072025-06-18T18:49:47.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51082025-06-18T18:49:47.830ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51092025-06-18T18:49:47.831ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51102025-06-18T18:49:47.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51112025-06-18T18:49:47.832ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51122025-06-18T18:49:47.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51132025-06-18T18:49:47.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51142025-06-18T18:49:47.833ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51152025-06-18T18:49:47.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51162025-06-18T18:49:47.840ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51172025-06-18T18:49:47.841ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
51182025-06-18T18:49:47.841ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "9bceadeb-e1f8-4986-9a4d-614b579d31ad", "date": "Wed, 18 Jun 2025 18:49:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51192025-06-18T18:49:47.841ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51202025-06-18T18:49:47.846ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7bf6e7a2-8db2-4aa8-851f-90b4a4e76749", "date": "Wed, 18 Jun 2025 18:49:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51212025-06-18T18:49:47.846ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51222025-06-18T18:49:47.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51232025-06-18T18:49:47.846ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51242025-06-18T18:49:47.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51252025-06-18T18:49:47.847ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51262025-06-18T18:49:47.847ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 285.998885ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
51272025-06-18T18:49:47.872ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 310.533644ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
51282025-06-18T18:49:47.872ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51292025-06-18T18:49:47.872ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
51302025-06-18T18:49:47.872ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51312025-06-18T18:49:47.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51322025-06-18T18:49:47.874ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
51332025-06-18T18:49:47.874ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = ab8dd933-5e45-404d-97a3-fdafa1c7d91b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
51342025-06-18T18:49:47.874ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51352025-06-18T18:49:47.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51362025-06-18T18:49:47.875ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51372025-06-18T18:49:47.876ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51382025-06-18T18:49:47.876ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51392025-06-18T18:49:47.876ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51402025-06-18T18:49:47.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9fbbc826-5b83-4b80-8172-66302c618aae, lookup_type: ById(9fbbc826-5b83-4b80-8172-66302c618aae) } result = Ok(())
51412025-06-18T18:49:47.879ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51422025-06-18T18:49:47.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51432025-06-18T18:49:47.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
51442025-06-18T18:49:47.879ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
51452025-06-18T18:49:47.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
51462025-06-18T18:49:47.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51472025-06-18T18:49:47.880ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51482025-06-18T18:49:47.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51492025-06-18T18:49:47.881ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
51502025-06-18T18:49:47.881ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51512025-06-18T18:49:47.881ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 320.512812ms iteration = 29 status = 0
51522025-06-18T18:49:47.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51532025-06-18T18:49:47.883ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = ab8dd933-5e45-404d-97a3-fdafa1c7d91b dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
51542025-06-18T18:49:47.883ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
51552025-06-18T18:49:47.883ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-18 18:36:19.303122 UTC dns_group = internal generation = 1
51562025-06-18T18:49:47.883ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 322.636461ms iteration = 15 status = {"generation":1}
51572025-06-18T18:49:47.886ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
51582025-06-18T18:49:47.886ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 72dd4529-6655-4d30-a1d8-0de429d0133c dns_zone_name = oxide.test found_so_far = 0 version = 2
51592025-06-18T18:49:47.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51602025-06-18T18:49:47.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51612025-06-18T18:49:47.887ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
51622025-06-18T18:49:47.887ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
51632025-06-18T18:49:47.887ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "446f90fc-4381-4426-911d-cfdb0d2ad0c9", "date": "Wed, 18 Jun 2025 18:49:47 GMT"} })
51642025-06-18T18:49:47.887ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51652025-06-18T18:49:47.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51662025-06-18T18:49:47.888ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51672025-06-18T18:49:47.889ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51682025-06-18T18:49:47.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51692025-06-18T18:49:47.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51702025-06-18T18:49:47.891ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51712025-06-18T18:49:47.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51722025-06-18T18:49:47.894ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 72dd4529-6655-4d30-a1d8-0de429d0133c dns_zone_name = oxide.test found_so_far = 4 version = 2
51732025-06-18T18:49:47.894ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
51742025-06-18T18:49:47.894ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-18 18:36:20.010620 UTC dns_group = external generation = 2
51752025-06-18T18:49:47.894ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 332.811312ms iteration = 15 status = {"generation":2}
51762025-06-18T18:49:47.894ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51772025-06-18T18:49:47.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51782025-06-18T18:49:47.896ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f zone_address = fd00:1122:3344:101::2
51792025-06-18T18:49:47.896ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51802025-06-18T18:49:47.896ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "613bffee-4679-4b5f-a3b2-1e8f50e06475", "content-length": "26", "date": "Wed, 18 Jun 2025 18:49:47 GMT"} })
51812025-06-18T18:49:47.896ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51822025-06-18T18:49:47.898ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
51832025-06-18T18:49:47.901ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
51842025-06-18T18:49:47.901ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51852025-06-18T18:49:47.902ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dce049b9-a071-42cb-a62e-35d6162a6be2", "date": "Wed, 18 Jun 2025 18:49:47 GMT"} })
51862025-06-18T18:49:47.903ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 342.320943ms iteration = 30 status = {}
51872025-06-18T18:49:47.904ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51882025-06-18T18:49:47.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51892025-06-18T18:49:47.905ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 344.440211ms iteration = 29 status = {}
51902025-06-18T18:49:47.907ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 346.145865ms iteration = 29 status = null
51912025-06-18T18:49:47.913ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51922025-06-18T18:49:47.913ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
51932025-06-18T18:49:47.913ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 352.477413ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
51942025-06-18T18:49:47.915ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
51952025-06-18T18:49:47.915ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 354.472651ms iteration = 29 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
51962025-06-18T18:49:47.925ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51972025-06-18T18:49:47.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51982025-06-18T18:49:47.927ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51992025-06-18T18:49:47.929ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
52002025-06-18T18:49:47.929ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52012025-06-18T18:49:47.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52022025-06-18T18:49:47.936ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
52032025-06-18T18:49:47.942ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52042025-06-18T18:49:47.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52052025-06-18T18:49:47.944ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52062025-06-18T18:49:47.945ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
52072025-06-18T18:49:47.945ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 384.007428ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
52082025-06-18T18:49:47.946ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52092025-06-18T18:49:47.946ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52102025-06-18T18:49:47.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52112025-06-18T18:49:47.950ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52122025-06-18T18:49:47.952ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52132025-06-18T18:49:47.952ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52142025-06-18T18:49:47.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52152025-06-18T18:49:47.958ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 396.862675ms iteration = 32 status = {"physical_disks_added":0}
52162025-06-18T18:49:47.974ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-18T18:35:46.206089Z, time_modified: 2025-06-18T18:35:46.206089Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 472c0288-095b-456c-b18f-d5f22a8efd72, db_silo: Silo { identity: SiloIdentity { id: 472c0288-095b-456c-b18f-d5f22a8efd72, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-18T18:36:19.955323Z, time_modified: 2025-06-18T18:36:19.955323Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 472c0288-095b-456c-b18f-d5f22a8efd72, db_silo: Silo { identity: SiloIdentity { id: 472c0288-095b-456c-b18f-d5f22a8efd72, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-18T18:36:19.955323Z, time_modified: 2025-06-18T18:36:19.955323Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3" }] }) }
52172025-06-18T18:49:47.974ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 412.886256ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"472c0288-095b-456c-b18f-d5f22a8efd72","tls_certs":["6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3"]}},"default_endpoint":{"silo_id":"472c0288-095b-456c-b18f-d5f22a8efd72","tls_certs":["6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
52182025-06-18T18:49:47.998ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
52192025-06-18T18:49:47.999ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "4e753dbd-c966-4273-9eb8-8e1a46b62875", "date": "Wed, 18 Jun 2025 18:49:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
52202025-06-18T18:49:47.999ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
52212025-06-18T18:49:48.001ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "67e3ed0d-fb95-45f4-9790-712b592628fc", "date": "Wed, 18 Jun 2025 18:49:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
52222025-06-18T18:49:48.001ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
52232025-06-18T18:49:48.002ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e4a7a50c-684d-4633-9b48-858f6f6111eb", "date": "Wed, 18 Jun 2025 18:49:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
52242025-06-18T18:49:48.002ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
52252025-06-18T18:49:48.004ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
52262025-06-18T18:49:48.004ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 443.613891ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
52272025-06-18T18:49:48.046ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52282025-06-18T18:49:48.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52292025-06-18T18:49:48.048ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 7e1ff921-047f-464e-8081-f8132af716ac, rack_id: 3a330d2e-6212-46a4-9781-374fdb3dc92f, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(6c07c314-d66b-4041-9040-d774200d26a9) } rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
52302025-06-18T18:49:48.048ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52312025-06-18T18:49:48.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52322025-06-18T18:49:48.052ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
52332025-06-18T18:49:48.052ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e7d3656-c4b4-44e2-bd53-ffbf36a98e1c", "content-length": "691", "date": "Wed, 18 Jun 2025 18:49:47 GMT"} })
52342025-06-18T18:49:48.053ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
52352025-06-18T18:49:48.053ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
52362025-06-18T18:49:48.053ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
52372025-06-18T18:49:48.054ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 493.444838ms iteration = 30 status = {}
52382025-06-18T18:49:48.060ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
52392025-06-18T18:49:48.060ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 6c07c314-d66b-4041-9040-d774200d26a9
52402025-06-18T18:49:48.061ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
52412025-06-18T18:49:48.061ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
52422025-06-18T18:49:48.061ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52432025-06-18T18:49:48.061ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52442025-06-18T18:49:48.061ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52452025-06-18T18:49:48.061ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52462025-06-18T18:49:48.061ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
52472025-06-18T18:49:48.061ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
52482025-06-18T18:49:48.061ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
52492025-06-18T18:49:48.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52502025-06-18T18:49:48.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52512025-06-18T18:49:48.063ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
52522025-06-18T18:49:48.063ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
52532025-06-18T18:49:48.168ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "974ff0ff-506a-425d-9dcb-21ec089c291c", "date": "Wed, 18 Jun 2025 18:49:47 GMT"} })
52542025-06-18T18:49:48.168ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch = Switch0
52552025-06-18T18:49:48.168ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
52562025-06-18T18:49:48.168ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4703e5dd-927c-413c-9b7a-77c15e77e74b", "content-length": "682", "date": "Wed, 18 Jun 2025 18:49:47 GMT"} })
52572025-06-18T18:49:48.168ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52582025-06-18T18:49:48.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52592025-06-18T18:49:48.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52602025-06-18T18:49:48.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52612025-06-18T18:49:48.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52622025-06-18T18:49:48.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52632025-06-18T18:49:48.178ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52642025-06-18T18:49:48.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52652025-06-18T18:49:48.185ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 624.210342ms iteration = 29 status = {}
52662025-06-18T18:49:48.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cbad6acb-9720-48ce-9d69-cf3fee2a75ac roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52672025-06-18T18:49:48.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cbad6acb-9720-48ce-9d69-cf3fee2a75ac resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52682025-06-18T18:49:48.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3156 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cbad6acb-9720-48ce-9d69-cf3fee2a75ac response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52692025-06-18T18:49:49.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 77207560-058c-475f-a90c-6728aabc2f15 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52702025-06-18T18:49:49.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 77207560-058c-475f-a90c-6728aabc2f15 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52712025-06-18T18:49:49.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2722 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 77207560-058c-475f-a90c-6728aabc2f15 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52722025-06-18T18:49:50.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1ce6b916-5948-4296-be98-23c98d91ceea roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52732025-06-18T18:49:50.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1ce6b916-5948-4296-be98-23c98d91ceea resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52742025-06-18T18:49:50.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3167 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1ce6b916-5948-4296-be98-23c98d91ceea response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52752025-06-18T18:49:51.126ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:58243
52762025-06-18T18:49:51.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58243 req_id = 51fa4e34-7773-4d41-911b-deee92c791c7 roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
52772025-06-18T18:49:51.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58243 req_id = 51fa4e34-7773-4d41-911b-deee92c791c7 resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
52782025-06-18T18:49:51.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2700 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58243 req_id = 51fa4e34-7773-4d41-911b-deee92c791c7 response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
52792025-06-18T18:49:51.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58243 req_id = 5b7928ea-56a3-421d-97e6-604c89d5f7b2 roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
52802025-06-18T18:49:51.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58243 req_id = 5b7928ea-56a3-421d-97e6-604c89d5f7b2 resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
52812025-06-18T18:49:51.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2680 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58243 req_id = 5b7928ea-56a3-421d-97e6-604c89d5f7b2 response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
52822025-06-18T18:49:51.134ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 565 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 1e3f4b68-1e62-4d7f-a28e-7a3189d5db60 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
52832025-06-18T18:49:51.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6ce3f51c-b31f-4b7a-8494-0c759a24d1df roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52842025-06-18T18:49:51.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6ce3f51c-b31f-4b7a-8494-0c759a24d1df resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52852025-06-18T18:49:51.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2260 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6ce3f51c-b31f-4b7a-8494-0c759a24d1df response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52862025-06-18T18:49:52.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e54c2e52-ca86-411b-b85a-f3ddb0fe150f roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52872025-06-18T18:49:52.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e54c2e52-ca86-411b-b85a-f3ddb0fe150f resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52882025-06-18T18:49:52.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2632 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e54c2e52-ca86-411b-b85a-f3ddb0fe150f response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52892025-06-18T18:49:53.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 27de390d-9a94-4a15-a118-863f18ccaa24 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52902025-06-18T18:49:53.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 27de390d-9a94-4a15-a118-863f18ccaa24 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52912025-06-18T18:49:53.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2730 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 27de390d-9a94-4a15-a118-863f18ccaa24 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52922025-06-18T18:49:54.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1e31d7a4-a869-4784-8a32-7fd63c5bfee4 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52932025-06-18T18:49:54.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1e31d7a4-a869-4784-8a32-7fd63c5bfee4 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52942025-06-18T18:49:54.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3110 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1e31d7a4-a869-4784-8a32-7fd63c5bfee4 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52952025-06-18T18:49:55.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 42dc3e71-0ba6-4a0e-8145-5bcee2d48fde roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52962025-06-18T18:49:55.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 42dc3e71-0ba6-4a0e-8145-5bcee2d48fde resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52972025-06-18T18:49:55.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3146 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 42dc3e71-0ba6-4a0e-8145-5bcee2d48fde response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52982025-06-18T18:49:56.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1ec9148b-2d69-44d8-9c89-37596f72390c roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
52992025-06-18T18:49:56.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1ec9148b-2d69-44d8-9c89-37596f72390c resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53002025-06-18T18:49:56.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2168 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1ec9148b-2d69-44d8-9c89-37596f72390c response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53012025-06-18T18:49:57.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0bca2b20-a550-47dc-b62a-48bc5aa100bb roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53022025-06-18T18:49:57.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0bca2b20-a550-47dc-b62a-48bc5aa100bb resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53032025-06-18T18:49:57.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2353 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0bca2b20-a550-47dc-b62a-48bc5aa100bb response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53042025-06-18T18:49:57.560ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
53052025-06-18T18:49:57.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53062025-06-18T18:49:57.560ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
53072025-06-18T18:49:57.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53082025-06-18T18:49:57.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53092025-06-18T18:49:57.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53102025-06-18T18:49:57.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53112025-06-18T18:49:57.563ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53122025-06-18T18:49:57.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53132025-06-18T18:49:57.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53142025-06-18T18:49:57.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53152025-06-18T18:49:57.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53162025-06-18T18:49:57.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53172025-06-18T18:49:57.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53182025-06-18T18:49:57.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53192025-06-18T18:49:57.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
53202025-06-18T18:49:57.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53212025-06-18T18:49:57.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53222025-06-18T18:49:57.585ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
53232025-06-18T18:49:57.585ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.408847ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
53242025-06-18T18:49:57.594ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.760046ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53252025-06-18T18:49:58.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0de30c72-a58f-4516-9506-62e1d2727db2 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53262025-06-18T18:49:58.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0de30c72-a58f-4516-9506-62e1d2727db2 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53272025-06-18T18:49:58.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2415 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0de30c72-a58f-4516-9506-62e1d2727db2 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53282025-06-18T18:49:59.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d868838c-c05f-4594-915d-48f3c2a31365 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53292025-06-18T18:49:59.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d868838c-c05f-4594-915d-48f3c2a31365 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53302025-06-18T18:49:59.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2500 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d868838c-c05f-4594-915d-48f3c2a31365 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53312025-06-18T18:50:00.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c2859803-eeb9-4e55-94e3-0d8f6e34e47d roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53322025-06-18T18:50:00.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c2859803-eeb9-4e55-94e3-0d8f6e34e47d resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53332025-06-18T18:50:00.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2122 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c2859803-eeb9-4e55-94e3-0d8f6e34e47d response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53342025-06-18T18:50:01.135ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 762 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 7ee60ecc-f7a0-4a97-a15e-4b4c7cafaf5c response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
53352025-06-18T18:50:01.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a4f4423f-36cd-428a-bf8b-bb8e5a3286f1 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53362025-06-18T18:50:01.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a4f4423f-36cd-428a-bf8b-bb8e5a3286f1 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53372025-06-18T18:50:01.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2508 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a4f4423f-36cd-428a-bf8b-bb8e5a3286f1 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53382025-06-18T18:50:02.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4b313839-db19-4a5a-8af1-1b07ec957b7f roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53392025-06-18T18:50:02.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4b313839-db19-4a5a-8af1-1b07ec957b7f resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53402025-06-18T18:50:02.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2432 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4b313839-db19-4a5a-8af1-1b07ec957b7f response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53412025-06-18T18:50:03.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 11d020be-df7f-4436-bbf5-c498ec17526d roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53422025-06-18T18:50:03.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 11d020be-df7f-4436-bbf5-c498ec17526d resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53432025-06-18T18:50:03.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2401 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 11d020be-df7f-4436-bbf5-c498ec17526d response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53442025-06-18T18:50:04.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8734f535-fc8a-48c3-90e2-793ee95f1271 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53452025-06-18T18:50:04.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8734f535-fc8a-48c3-90e2-793ee95f1271 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53462025-06-18T18:50:04.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2808 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8734f535-fc8a-48c3-90e2-793ee95f1271 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53472025-06-18T18:50:05.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e4eda646-bc81-4d79-833f-15f1e7bb89dc roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53482025-06-18T18:50:05.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e4eda646-bc81-4d79-833f-15f1e7bb89dc resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53492025-06-18T18:50:05.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2003 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e4eda646-bc81-4d79-833f-15f1e7bb89dc response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53502025-06-18T18:50:06.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58243 req_id = d3ff6c4a-8fdd-4708-a2c1-d58ff1683bbd roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
53512025-06-18T18:50:06.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58243 req_id = d3ff6c4a-8fdd-4708-a2c1-d58ff1683bbd resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
53522025-06-18T18:50:06.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3737 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58243 req_id = d3ff6c4a-8fdd-4708-a2c1-d58ff1683bbd response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
53532025-06-18T18:50:06.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58243 req_id = 2b263388-df09-407c-9bef-d24447a33bec roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
53542025-06-18T18:50:06.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58243 req_id = 2b263388-df09-407c-9bef-d24447a33bec resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
53552025-06-18T18:50:06.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58243 req_id = 2b263388-df09-407c-9bef-d24447a33bec response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
53562025-06-18T18:50:06.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4f805b9a-910e-4717-8ccc-d42a2a440ec5 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53572025-06-18T18:50:06.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4f805b9a-910e-4717-8ccc-d42a2a440ec5 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53582025-06-18T18:50:06.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2808 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4f805b9a-910e-4717-8ccc-d42a2a440ec5 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53592025-06-18T18:50:07.561ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
53602025-06-18T18:50:07.561ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
53612025-06-18T18:50:07.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53622025-06-18T18:50:07.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53632025-06-18T18:50:07.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53642025-06-18T18:50:07.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53652025-06-18T18:50:07.564ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53662025-06-18T18:50:07.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53672025-06-18T18:50:07.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53682025-06-18T18:50:07.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53692025-06-18T18:50:07.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53702025-06-18T18:50:07.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53712025-06-18T18:50:07.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53722025-06-18T18:50:07.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53732025-06-18T18:50:07.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53742025-06-18T18:50:07.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
53752025-06-18T18:50:07.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53762025-06-18T18:50:07.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53772025-06-18T18:50:07.586ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
53782025-06-18T18:50:07.586ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.094266ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
53792025-06-18T18:50:07.597ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.17073ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53802025-06-18T18:50:07.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e6e4e334-5879-47b6-a7a1-c460063520a4 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53812025-06-18T18:50:07.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e6e4e334-5879-47b6-a7a1-c460063520a4 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53822025-06-18T18:50:07.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2096 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e6e4e334-5879-47b6-a7a1-c460063520a4 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53832025-06-18T18:50:08.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 715f8910-f8af-41c7-8e2d-e19e3465719f roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53842025-06-18T18:50:08.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 715f8910-f8af-41c7-8e2d-e19e3465719f resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53852025-06-18T18:50:08.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2518 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 715f8910-f8af-41c7-8e2d-e19e3465719f response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53862025-06-18T18:50:09.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7c4f44ef-2501-4d8e-bddd-5c8e5e7e67d3 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53872025-06-18T18:50:09.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7c4f44ef-2501-4d8e-bddd-5c8e5e7e67d3 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53882025-06-18T18:50:09.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2135 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7c4f44ef-2501-4d8e-bddd-5c8e5e7e67d3 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53892025-06-18T18:50:10.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8de0fa3d-39cf-427f-a6b4-d132b35ac980 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53902025-06-18T18:50:10.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8de0fa3d-39cf-427f-a6b4-d132b35ac980 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53912025-06-18T18:50:10.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3021 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8de0fa3d-39cf-427f-a6b4-d132b35ac980 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53922025-06-18T18:50:11.136ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 930 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 3328af49-b15d-40aa-b571-d4db166ba8d4 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
53932025-06-18T18:50:11.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a094b700-1db7-4fd5-ada8-a237390db58e roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53942025-06-18T18:50:11.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a094b700-1db7-4fd5-ada8-a237390db58e resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53952025-06-18T18:50:11.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2392 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a094b700-1db7-4fd5-ada8-a237390db58e response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53962025-06-18T18:50:12.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 206cce80-a3fd-422c-a389-058439e066b0 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53972025-06-18T18:50:12.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 206cce80-a3fd-422c-a389-058439e066b0 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53982025-06-18T18:50:12.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1877 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 206cce80-a3fd-422c-a389-058439e066b0 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
53992025-06-18T18:50:13.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6aae9107-7c87-4694-8380-ab8a3c4d820b roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
54002025-06-18T18:50:13.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6aae9107-7c87-4694-8380-ab8a3c4d820b resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
54012025-06-18T18:50:13.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2373 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6aae9107-7c87-4694-8380-ab8a3c4d820b response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
54022025-06-18T18:50:14.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7f4ac61f-a8dc-4d5f-a136-ed2fce3bcd8d roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
54032025-06-18T18:50:14.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7f4ac61f-a8dc-4d5f-a136-ed2fce3bcd8d resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
54042025-06-18T18:50:14.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2642 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7f4ac61f-a8dc-4d5f-a136-ed2fce3bcd8d response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
54052025-06-18T18:50:15.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6e8e99e3-4002-42e6-84b2-a579c81d3ca7 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
54062025-06-18T18:50:15.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6e8e99e3-4002-42e6-84b2-a579c81d3ca7 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
54072025-06-18T18:50:15.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2661 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6e8e99e3-4002-42e6-84b2-a579c81d3ca7 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
54082025-06-18T18:50:16.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = dff85c2a-2be2-4652-8809-0ace8effc39a roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
54092025-06-18T18:50:16.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = dff85c2a-2be2-4652-8809-0ace8effc39a resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
54102025-06-18T18:50:16.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2701 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = dff85c2a-2be2-4652-8809-0ace8effc39a response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
54112025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
54122025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54132025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
54142025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54152025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 30 reason = Timeout
54162025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
54172025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54182025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
54192025-06-18T18:50:17.561ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
54202025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
54212025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54222025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54232025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 30 reason = Timeout
54242025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
54252025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
54262025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54272025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
54282025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54292025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
54302025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54312025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
54322025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
54332025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54342025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54352025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
54362025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54372025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
54382025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
54392025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
54402025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54412025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
54422025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
54432025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54442025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
54452025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
54462025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54472025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
54482025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
54492025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
54502025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
54512025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54522025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54532025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
54542025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54552025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54562025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54572025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54582025-06-18T18:50:17.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
54592025-06-18T18:50:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
54602025-06-18T18:50:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54612025-06-18T18:50:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54622025-06-18T18:50:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
54632025-06-18T18:50:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54642025-06-18T18:50:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54652025-06-18T18:50:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
54662025-06-18T18:50:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54672025-06-18T18:50:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54682025-06-18T18:50:17.564ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54692025-06-18T18:50:17.564ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54702025-06-18T18:50:17.566ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.0695ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
54712025-06-18T18:50:17.566ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54722025-06-18T18:50:17.566ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54732025-06-18T18:50:17.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54742025-06-18T18:50:17.568ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54752025-06-18T18:50:17.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54762025-06-18T18:50:17.568ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54772025-06-18T18:50:17.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54782025-06-18T18:50:17.568ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 7.772807ms iteration = 30 status = {"errors":[],"requests_created_ok":[]}
54792025-06-18T18:50:17.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54802025-06-18T18:50:17.570ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54812025-06-18T18:50:17.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54822025-06-18T18:50:17.571ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1807, tv_nsec: 149100972 } })
54832025-06-18T18:50:17.571ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
54842025-06-18T18:50:17.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54852025-06-18T18:50:17.572ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.357436ms iteration = 30 status = {"errors":[],"finish_invoked_ok":[]}
54862025-06-18T18:50:17.575ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1807, tv_nsec: 153188278 } })
54872025-06-18T18:50:17.575ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
54882025-06-18T18:50:17.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54892025-06-18T18:50:17.575ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54902025-06-18T18:50:17.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54912025-06-18T18:50:17.579ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54922025-06-18T18:50:17.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54932025-06-18T18:50:17.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54942025-06-18T18:50:17.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54952025-06-18T18:50:17.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54962025-06-18T18:50:17.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54972025-06-18T18:50:17.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54982025-06-18T18:50:17.583ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54992025-06-18T18:50:17.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55002025-06-18T18:50:17.583ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
55012025-06-18T18:50:17.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55022025-06-18T18:50:17.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55032025-06-18T18:50:17.585ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55042025-06-18T18:50:17.586ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55052025-06-18T18:50:17.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55062025-06-18T18:50:17.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
55072025-06-18T18:50:17.590ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55082025-06-18T18:50:17.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55092025-06-18T18:50:17.592ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55102025-06-18T18:50:17.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55112025-06-18T18:50:17.595ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55122025-06-18T18:50:17.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55132025-06-18T18:50:17.610ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
55142025-06-18T18:50:17.610ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.224099ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
55152025-06-18T18:50:17.612ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55162025-06-18T18:50:17.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55172025-06-18T18:50:17.615ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55182025-06-18T18:50:17.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55192025-06-18T18:50:17.616ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.10442ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
55202025-06-18T18:50:17.617ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
55212025-06-18T18:50:17.617ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55222025-06-18T18:50:17.617ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2bfbebd1-7a57-41d7-bd42-3fb260455fe1", "content-length": "26", "date": "Wed, 18 Jun 2025 18:50:17 GMT"} })
55232025-06-18T18:50:17.617ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55242025-06-18T18:50:17.618ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55252025-06-18T18:50:17.619ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55262025-06-18T18:50:17.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55272025-06-18T18:50:17.620ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55282025-06-18T18:50:17.620ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55292025-06-18T18:50:17.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55302025-06-18T18:50:17.620ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 59.309848ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55312025-06-18T18:50:17.622ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55322025-06-18T18:50:17.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55332025-06-18T18:50:17.623ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55342025-06-18T18:50:17.623ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
55352025-06-18T18:50:17.623ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55362025-06-18T18:50:17.623ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
55372025-06-18T18:50:17.623ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55382025-06-18T18:50:17.623ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fd35565-e31d-42ad-a48e-5b5c043a09ce", "content-length": "26", "date": "Wed, 18 Jun 2025 18:50:17 GMT"} })
55392025-06-18T18:50:17.623ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55402025-06-18T18:50:17.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55412025-06-18T18:50:17.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
55422025-06-18T18:50:17.624ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
55432025-06-18T18:50:17.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
55442025-06-18T18:50:17.624ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55452025-06-18T18:50:17.626ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55462025-06-18T18:50:17.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55472025-06-18T18:50:17.628ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55482025-06-18T18:50:17.631ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55492025-06-18T18:50:17.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55502025-06-18T18:50:17.632ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55512025-06-18T18:50:17.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9fbbc826-5b83-4b80-8172-66302c618aae, lookup_type: ById(9fbbc826-5b83-4b80-8172-66302c618aae) } result = Ok(())
55522025-06-18T18:50:17.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55532025-06-18T18:50:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55542025-06-18T18:50:17.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
55552025-06-18T18:50:17.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55562025-06-18T18:50:17.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55572025-06-18T18:50:17.639ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 78.235469ms iteration = 30 status = 0
55582025-06-18T18:50:17.643ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1807, tv_nsec: 221437600 } })
55592025-06-18T18:50:17.643ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
55602025-06-18T18:50:17.644ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
55612025-06-18T18:50:17.644ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 83.092717ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
55622025-06-18T18:50:17.658ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55632025-06-18T18:50:17.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55642025-06-18T18:50:17.661ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 100.682489ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55652025-06-18T18:50:17.663ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
55662025-06-18T18:50:17.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
55672025-06-18T18:50:17.665ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55682025-06-18T18:50:17.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
55692025-06-18T18:50:17.667ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
55702025-06-18T18:50:17.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
55712025-06-18T18:50:17.669ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
55722025-06-18T18:50:17.669ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 108.378025ms iteration = 30 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
55732025-06-18T18:50:17.673ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 111.792252ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55742025-06-18T18:50:17.674ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55752025-06-18T18:50:17.674ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
55762025-06-18T18:50:17.674ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55772025-06-18T18:50:17.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55782025-06-18T18:50:17.676ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 114.653782ms iteration = 30 status = {}
55792025-06-18T18:50:17.677ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55802025-06-18T18:50:17.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55812025-06-18T18:50:17.692ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f zone_address = fd00:1122:3344:101::2
55822025-06-18T18:50:17.692ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55832025-06-18T18:50:17.692ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a151d561-78fe-4eb9-9e4e-908dbab49d34", "content-length": "26", "date": "Wed, 18 Jun 2025 18:50:17 GMT"} })
55842025-06-18T18:50:17.692ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55852025-06-18T18:50:17.693ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 132.446437ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
55862025-06-18T18:50:17.695ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
55872025-06-18T18:50:17.718ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 156.978436ms iteration = 33 status = {"physical_disks_added":0}
55882025-06-18T18:50:17.718ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
55892025-06-18T18:50:17.718ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55902025-06-18T18:50:17.718ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "53f50b23-34ef-4843-9919-57980a72bb95", "content-length": "372", "date": "Wed, 18 Jun 2025 18:50:17 GMT"} })
55912025-06-18T18:50:17.718ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55922025-06-18T18:50:17.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55932025-06-18T18:50:17.720ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 159.44257ms iteration = 30 status = null
55942025-06-18T18:50:17.738ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
55952025-06-18T18:50:17.738ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
55962025-06-18T18:50:17.739ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1670ad55-2a4a-400a-bc4a-6ce21d4a745e", "date": "Wed, 18 Jun 2025 18:50:17 GMT"} })
55972025-06-18T18:50:17.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55982025-06-18T18:50:17.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55992025-06-18T18:50:17.741ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56002025-06-18T18:50:17.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56012025-06-18T18:50:17.744ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56022025-06-18T18:50:17.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56032025-06-18T18:50:17.747ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
56042025-06-18T18:50:17.747ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56052025-06-18T18:50:17.748ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "85fd9004-154c-41f5-8949-ebfcc538dc44", "date": "Wed, 18 Jun 2025 18:50:17 GMT"} })
56062025-06-18T18:50:17.749ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 188.42602ms iteration = 31 status = {}
56072025-06-18T18:50:17.752ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56082025-06-18T18:50:17.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56092025-06-18T18:50:17.760ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56102025-06-18T18:50:17.760ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
56112025-06-18T18:50:17.760ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 198.808613ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
56122025-06-18T18:50:17.784ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56132025-06-18T18:50:17.786ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56142025-06-18T18:50:17.786ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56152025-06-18T18:50:17.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56162025-06-18T18:50:17.787ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56172025-06-18T18:50:17.789ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56182025-06-18T18:50:17.789ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56192025-06-18T18:50:17.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56202025-06-18T18:50:17.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56212025-06-18T18:50:17.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56222025-06-18T18:50:17.803ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 7e1ff921-047f-464e-8081-f8132af716ac, rack_id: 3a330d2e-6212-46a4-9781-374fdb3dc92f, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(6c07c314-d66b-4041-9040-d774200d26a9) } rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
56232025-06-18T18:50:17.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56242025-06-18T18:50:17.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56252025-06-18T18:50:17.815ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
56262025-06-18T18:50:17.816ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 6c07c314-d66b-4041-9040-d774200d26a9
56272025-06-18T18:50:17.816ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
56282025-06-18T18:50:17.816ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56292025-06-18T18:50:17.816ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56302025-06-18T18:50:17.816ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56312025-06-18T18:50:17.816ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56322025-06-18T18:50:17.816ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56332025-06-18T18:50:17.816ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56342025-06-18T18:50:17.816ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56352025-06-18T18:50:17.816ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
56362025-06-18T18:50:17.816ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56372025-06-18T18:50:17.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56382025-06-18T18:50:17.819ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
56392025-06-18T18:50:17.819ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
56402025-06-18T18:50:17.826ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
56412025-06-18T18:50:17.922ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0e0e7ecf-1769-4597-bee5-b73583f99ae6", "date": "Wed, 18 Jun 2025 18:50:17 GMT"} })
56422025-06-18T18:50:17.922ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch = Switch0
56432025-06-18T18:50:17.922ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
56442025-06-18T18:50:17.923ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3db34cf-fdbc-4bc8-ab0e-b46be35ec0f4", "content-length": "682", "date": "Wed, 18 Jun 2025 18:50:17 GMT"} })
56452025-06-18T18:50:17.923ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56462025-06-18T18:50:17.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56472025-06-18T18:50:17.923ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "883e8ffc-f868-41cd-999e-b3e82fe13e0f", "content-length": "691", "date": "Wed, 18 Jun 2025 18:50:17 GMT"} })
56482025-06-18T18:50:17.923ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
56492025-06-18T18:50:17.923ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
56502025-06-18T18:50:17.923ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
56512025-06-18T18:50:17.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 111cada5-3497-4674-a51f-b9659153993e roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56522025-06-18T18:50:17.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 111cada5-3497-4674-a51f-b9659153993e resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56532025-06-18T18:50:17.924ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 363.360753ms iteration = 31 status = {}
56542025-06-18T18:50:17.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2179 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 111cada5-3497-4674-a51f-b9659153993e response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56552025-06-18T18:50:17.927ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56562025-06-18T18:50:17.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56572025-06-18T18:50:17.930ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56582025-06-18T18:50:17.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56592025-06-18T18:50:17.932ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56602025-06-18T18:50:17.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56612025-06-18T18:50:17.939ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 378.253988ms iteration = 30 status = {}
56622025-06-18T18:50:18.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 80c36a67-acc3-447a-9518-d6765a30aca9 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56632025-06-18T18:50:18.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 80c36a67-acc3-447a-9518-d6765a30aca9 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56642025-06-18T18:50:18.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1938 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 80c36a67-acc3-447a-9518-d6765a30aca9 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56652025-06-18T18:50:19.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4624b4ac-210c-4f4a-b443-9bf6bba34676 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56662025-06-18T18:50:19.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4624b4ac-210c-4f4a-b443-9bf6bba34676 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56672025-06-18T18:50:19.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2376 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4624b4ac-210c-4f4a-b443-9bf6bba34676 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56682025-06-18T18:50:20.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8e460b18-ee24-4455-81fd-b92e2b81725c roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56692025-06-18T18:50:20.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8e460b18-ee24-4455-81fd-b92e2b81725c resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56702025-06-18T18:50:20.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2408 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8e460b18-ee24-4455-81fd-b92e2b81725c response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56712025-06-18T18:50:21.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58243 req_id = 98c0c4b9-39dc-4797-8b6d-3d5c79969951 roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
56722025-06-18T18:50:21.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58243 req_id = 98c0c4b9-39dc-4797-8b6d-3d5c79969951 resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
56732025-06-18T18:50:21.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3024 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58243 req_id = 98c0c4b9-39dc-4797-8b6d-3d5c79969951 response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
56742025-06-18T18:50:21.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58243 req_id = 21ee098e-dfb0-442a-8138-eae04a764071 roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
56752025-06-18T18:50:21.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58243 req_id = 21ee098e-dfb0-442a-8138-eae04a764071 resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
56762025-06-18T18:50:21.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2203 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58243 req_id = 21ee098e-dfb0-442a-8138-eae04a764071 response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
56772025-06-18T18:50:21.135ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 515 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 115fb826-2f18-4877-8c21-705da3663fe9 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
56782025-06-18T18:50:21.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 642e17a4-e46c-4a3b-a5c7-547c14f175c4 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56792025-06-18T18:50:21.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 642e17a4-e46c-4a3b-a5c7-547c14f175c4 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56802025-06-18T18:50:21.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1864 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 642e17a4-e46c-4a3b-a5c7-547c14f175c4 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56812025-06-18T18:50:23.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e954654d-5f79-4cbb-8e6f-72398bd87bde roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56822025-06-18T18:50:23.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e954654d-5f79-4cbb-8e6f-72398bd87bde resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56832025-06-18T18:50:23.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2381 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e954654d-5f79-4cbb-8e6f-72398bd87bde response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56842025-06-18T18:50:24.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4bdf24d1-78ec-4859-89ef-60a9c1b288eb roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56852025-06-18T18:50:24.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4bdf24d1-78ec-4859-89ef-60a9c1b288eb resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56862025-06-18T18:50:24.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2234 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4bdf24d1-78ec-4859-89ef-60a9c1b288eb response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56872025-06-18T18:50:25.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 64b4187c-e58d-4d3b-9cd4-b26f6f261821 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56882025-06-18T18:50:25.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 64b4187c-e58d-4d3b-9cd4-b26f6f261821 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56892025-06-18T18:50:25.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2300 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 64b4187c-e58d-4d3b-9cd4-b26f6f261821 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56902025-06-18T18:50:26.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6635e361-c0c7-42a8-8bad-305b486feba2 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56912025-06-18T18:50:26.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6635e361-c0c7-42a8-8bad-305b486feba2 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56922025-06-18T18:50:26.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2525 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6635e361-c0c7-42a8-8bad-305b486feba2 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56932025-06-18T18:50:27.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cf0976ef-a76b-400a-9fac-9d53ee7bf16b roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56942025-06-18T18:50:27.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cf0976ef-a76b-400a-9fac-9d53ee7bf16b resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56952025-06-18T18:50:27.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1884 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cf0976ef-a76b-400a-9fac-9d53ee7bf16b response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
56962025-06-18T18:50:27.560ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
56972025-06-18T18:50:27.560ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
56982025-06-18T18:50:27.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56992025-06-18T18:50:27.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57002025-06-18T18:50:27.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57012025-06-18T18:50:27.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57022025-06-18T18:50:27.563ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57032025-06-18T18:50:27.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57042025-06-18T18:50:27.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57052025-06-18T18:50:27.564ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.162357ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57062025-06-18T18:50:27.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57072025-06-18T18:50:27.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57082025-06-18T18:50:27.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57092025-06-18T18:50:27.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57102025-06-18T18:50:27.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57112025-06-18T18:50:27.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57122025-06-18T18:50:27.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
57132025-06-18T18:50:27.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57142025-06-18T18:50:27.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57152025-06-18T18:50:27.582ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
57162025-06-18T18:50:27.582ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.054924ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
57172025-06-18T18:50:28.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5459a553-d71b-4049-93b4-3ab7f7add583 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57182025-06-18T18:50:28.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5459a553-d71b-4049-93b4-3ab7f7add583 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57192025-06-18T18:50:28.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2377 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5459a553-d71b-4049-93b4-3ab7f7add583 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57202025-06-18T18:50:29.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9eb51b0c-4459-45b8-ba32-1969d3208965 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57212025-06-18T18:50:29.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9eb51b0c-4459-45b8-ba32-1969d3208965 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57222025-06-18T18:50:29.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2644 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9eb51b0c-4459-45b8-ba32-1969d3208965 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57232025-06-18T18:50:30.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d37ed318-cc69-47c6-81ab-f5d421d69b10 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57242025-06-18T18:50:30.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d37ed318-cc69-47c6-81ab-f5d421d69b10 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57252025-06-18T18:50:30.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2917 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d37ed318-cc69-47c6-81ab-f5d421d69b10 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57262025-06-18T18:50:31.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9a5a2b59-1ac3-4d8d-82f7-10f60d994fee roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57272025-06-18T18:50:31.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9a5a2b59-1ac3-4d8d-82f7-10f60d994fee resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57282025-06-18T18:50:31.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2347 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9a5a2b59-1ac3-4d8d-82f7-10f60d994fee response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57292025-06-18T18:50:31.135ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 588 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 2d7b489a-7298-4e83-a2ba-41790366f83c response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
57302025-06-18T18:50:32.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a0f184a2-cebf-4145-b47a-60658afba450 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57312025-06-18T18:50:32.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a0f184a2-cebf-4145-b47a-60658afba450 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57322025-06-18T18:50:32.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2757 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a0f184a2-cebf-4145-b47a-60658afba450 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57332025-06-18T18:50:33.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7e8ea9f2-349a-4193-b94f-f08ea3e85aad roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57342025-06-18T18:50:33.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7e8ea9f2-349a-4193-b94f-f08ea3e85aad resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57352025-06-18T18:50:33.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2745 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7e8ea9f2-349a-4193-b94f-f08ea3e85aad response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57362025-06-18T18:50:34.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cadc18c1-7eb0-4813-bc0f-e49d24e956e8 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57372025-06-18T18:50:34.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cadc18c1-7eb0-4813-bc0f-e49d24e956e8 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57382025-06-18T18:50:34.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2805 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cadc18c1-7eb0-4813-bc0f-e49d24e956e8 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57392025-06-18T18:50:35.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f7481ec0-6543-4d49-b03e-03ea4515b540 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57402025-06-18T18:50:35.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f7481ec0-6543-4d49-b03e-03ea4515b540 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57412025-06-18T18:50:35.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2450 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f7481ec0-6543-4d49-b03e-03ea4515b540 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57422025-06-18T18:50:36.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 828d3213-994e-424b-8a83-4a2cb9ef5ba9 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57432025-06-18T18:50:36.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 828d3213-994e-424b-8a83-4a2cb9ef5ba9 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57442025-06-18T18:50:36.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2115 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 828d3213-994e-424b-8a83-4a2cb9ef5ba9 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57452025-06-18T18:50:37.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 312fb6f6-0566-4013-9e19-b2b8ea789ffb roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57462025-06-18T18:50:37.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 312fb6f6-0566-4013-9e19-b2b8ea789ffb resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57472025-06-18T18:50:37.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2179 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 312fb6f6-0566-4013-9e19-b2b8ea789ffb response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57482025-06-18T18:50:37.561ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
57492025-06-18T18:50:37.561ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
57502025-06-18T18:50:37.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57512025-06-18T18:50:37.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57522025-06-18T18:50:37.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57532025-06-18T18:50:37.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57542025-06-18T18:50:37.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57552025-06-18T18:50:37.564ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57562025-06-18T18:50:37.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57572025-06-18T18:50:37.566ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.325344ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57582025-06-18T18:50:37.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57592025-06-18T18:50:37.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57602025-06-18T18:50:37.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57612025-06-18T18:50:37.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57622025-06-18T18:50:37.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57632025-06-18T18:50:37.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57642025-06-18T18:50:37.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
57652025-06-18T18:50:37.573ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57662025-06-18T18:50:37.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57672025-06-18T18:50:37.583ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
57682025-06-18T18:50:37.583ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.042384ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
57692025-06-18T18:50:38.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ce238332-f7c4-4db1-9c91-c0967fe9762c roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57702025-06-18T18:50:38.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ce238332-f7c4-4db1-9c91-c0967fe9762c resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57712025-06-18T18:50:38.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2176 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = ce238332-f7c4-4db1-9c91-c0967fe9762c response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57722025-06-18T18:50:39.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = fdb02df5-a690-4d8e-8466-f81de1f66537 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57732025-06-18T18:50:39.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = fdb02df5-a690-4d8e-8466-f81de1f66537 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57742025-06-18T18:50:39.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2814 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = fdb02df5-a690-4d8e-8466-f81de1f66537 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57752025-06-18T18:50:40.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0b95e47d-d6fc-4b15-b9fd-8782ebb34dfa roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57762025-06-18T18:50:40.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0b95e47d-d6fc-4b15-b9fd-8782ebb34dfa resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57772025-06-18T18:50:40.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2511 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0b95e47d-d6fc-4b15-b9fd-8782ebb34dfa response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57782025-06-18T18:50:41.136ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1053 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 2474e7a1-68d8-4524-a7d0-8abab292d220 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
57792025-06-18T18:50:41.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8e1918cb-bd52-41fb-90ee-a12f6ff77439 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57802025-06-18T18:50:41.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8e1918cb-bd52-41fb-90ee-a12f6ff77439 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57812025-06-18T18:50:41.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2472 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8e1918cb-bd52-41fb-90ee-a12f6ff77439 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57822025-06-18T18:50:42.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bd318fe2-bead-4706-8861-bde667409af3 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57832025-06-18T18:50:42.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bd318fe2-bead-4706-8861-bde667409af3 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57842025-06-18T18:50:42.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2303 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bd318fe2-bead-4706-8861-bde667409af3 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57852025-06-18T18:50:43.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4bd85bab-3f9f-45a6-8d08-5fd2f7b50988 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57862025-06-18T18:50:43.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4bd85bab-3f9f-45a6-8d08-5fd2f7b50988 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57872025-06-18T18:50:43.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2718 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4bd85bab-3f9f-45a6-8d08-5fd2f7b50988 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57882025-06-18T18:50:44.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0094857b-a477-402a-a73c-7dade38b3fb5 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57892025-06-18T18:50:44.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0094857b-a477-402a-a73c-7dade38b3fb5 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57902025-06-18T18:50:44.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2764 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0094857b-a477-402a-a73c-7dade38b3fb5 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57912025-06-18T18:50:45.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bf56f747-c33a-4d5b-b3ca-fa68576c4428 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57922025-06-18T18:50:45.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bf56f747-c33a-4d5b-b3ca-fa68576c4428 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57932025-06-18T18:50:45.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2018 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bf56f747-c33a-4d5b-b3ca-fa68576c4428 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57942025-06-18T18:50:46.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9c419e30-b465-4c82-a99a-10e6149133fb roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57952025-06-18T18:50:46.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9c419e30-b465-4c82-a99a-10e6149133fb resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57962025-06-18T18:50:46.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2620 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9c419e30-b465-4c82-a99a-10e6149133fb response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57972025-06-18T18:50:47.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e91b7535-eef4-46f1-9be4-4b665fa738c7 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57982025-06-18T18:50:47.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e91b7535-eef4-46f1-9be4-4b665fa738c7 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
57992025-06-18T18:50:47.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2909 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e91b7535-eef4-46f1-9be4-4b665fa738c7 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
58002025-06-18T18:50:47.561ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 91 reason = Timeout
58012025-06-18T18:50:47.561ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 18 reason = Timeout
58022025-06-18T18:50:47.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58032025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 16 reason = Timeout
58042025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58052025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
58062025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 31 reason = Timeout
58072025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58082025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 18 reason = Timeout
58092025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 31 reason = Timeout
58102025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
58112025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
58122025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
58132025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58142025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 16 reason = Timeout
58152025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
58162025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 16 reason = Timeout
58172025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
58182025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
58192025-06-18T18:50:47.562ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
58202025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58212025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
58222025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 31 reason = Timeout
58232025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58242025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
58252025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 16 reason = Timeout
58262025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
58272025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
58282025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58292025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 32 reason = Timeout
58302025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58312025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 31 reason = Timeout
58322025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
58332025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 31 reason = Timeout
58342025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58352025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
58362025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 31 reason = Timeout
58372025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 4 reason = Timeout
58382025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 31 reason = Timeout
58392025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
58402025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58412025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 31 reason = Timeout
58422025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58432025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 31 reason = Timeout
58442025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
58452025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 31 reason = Timeout
58462025-06-18T18:50:47.562ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58472025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 32 reason = Timeout
58482025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
58492025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
58502025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
58512025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58522025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 31 reason = Timeout
58532025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 91 reason = Timeout
58542025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58552025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58562025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 17 reason = Timeout
58572025-06-18T18:50:47.563ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe
58582025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.67\u{b5}s iteration = 17 status = {"enabled":false,"target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe"}
58592025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 4 reason = Timeout
58602025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 7 reason = Timeout
58612025-06-18T18:50:47.563ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
58622025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
58632025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58642025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58652025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
58662025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
58672025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58682025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 7 reason = Timeout
58692025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
58702025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
58712025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
58722025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 16 reason = Timeout
58732025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58742025-06-18T18:50:47.563ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-18 18:40:47.562981947 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
58752025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
58762025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 31 reason = Timeout
58772025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 31 reason = Timeout
58782025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
58792025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58802025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 16 reason = Timeout
58812025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
58822025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58832025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 16 reason = Timeout
58842025-06-18T18:50:47.563ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
58852025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
58862025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
58872025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58882025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
58892025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
58902025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58912025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
58922025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58932025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58942025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
58952025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58962025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58972025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
58982025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58992025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59002025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59012025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59022025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
59032025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59042025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59052025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
59062025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
59072025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
59082025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59092025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59102025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
59112025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
59122025-06-18T18:50:47.563ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("03fce462-e4e1-4a86-890b-8a2ae9e17168.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("800703b5-0601-4ce2-acc3-d5b9ca473160.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("800703b5-0601-4ce2-acc3-d5b9ca473160.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1837, tv_nsec: 141380108 } })
59132025-06-18T18:50:47.563ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("51411444-5ad0-46e8-b345-7ee26fb32a60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("adea75c9-2ff2-4f9f-bfac-48c7702333e0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea7c6eed-68db-4cd0-929a-17b08777d263.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea7c6eed-68db-4cd0-929a-17b08777d263.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1837, tv_nsec: 141393988 } })
59142025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59152025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59162025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59172025-06-18T18:50:47.563ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59182025-06-18T18:50:47.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59192025-06-18T18:50:47.564ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
59202025-06-18T18:50:47.564ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59212025-06-18T18:50:47.564ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 940.883\u{b5}s iteration = 16 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
59222025-06-18T18:50:47.564ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
59232025-06-18T18:50:47.564ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.257808ms iteration = 16 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
59242025-06-18T18:50:47.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59252025-06-18T18:50:47.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59262025-06-18T18:50:47.565ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
59272025-06-18T18:50:47.565ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 3.568639ms iteration = 16 status = {"by_rx":{},"error":null}
59282025-06-18T18:50:47.566ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.147498ms iteration = 31 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
59292025-06-18T18:50:47.566ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1837, tv_nsec: 144617432 } })
59302025-06-18T18:50:47.566ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.643224ms iteration = 16 status = {"errors":[],"found_port_ok":[]}
59312025-06-18T18:50:47.567ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
59322025-06-18T18:50:47.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59332025-06-18T18:50:47.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59342025-06-18T18:50:47.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59352025-06-18T18:50:47.568ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59362025-06-18T18:50:47.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59372025-06-18T18:50:47.570ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59382025-06-18T18:50:47.570ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.416226ms iteration = 31 status = {"errors":[],"garbage_collect_requested":[]}
59392025-06-18T18:50:47.571ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59402025-06-18T18:50:47.572ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59412025-06-18T18:50:47.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59422025-06-18T18:50:47.572ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59432025-06-18T18:50:47.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59442025-06-18T18:50:47.574ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
59452025-06-18T18:50:47.575ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59462025-06-18T18:50:47.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59472025-06-18T18:50:47.575ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1837, tv_nsec: 152866906 } })
59482025-06-18T18:50:47.575ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
59492025-06-18T18:50:47.575ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59502025-06-18T18:50:47.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59512025-06-18T18:50:47.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59522025-06-18T18:50:47.580ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59532025-06-18T18:50:47.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59542025-06-18T18:50:47.582ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59552025-06-18T18:50:47.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59562025-06-18T18:50:47.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59572025-06-18T18:50:47.583ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59582025-06-18T18:50:47.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
59592025-06-18T18:50:47.585ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
59602025-06-18T18:50:47.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
59612025-06-18T18:50:47.587ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59622025-06-18T18:50:47.587ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
59632025-06-18T18:50:47.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
59642025-06-18T18:50:47.588ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-18 18:40:47.562981947 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
59652025-06-18T18:50:47.588ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 25.709505ms iteration = 16 status = {"expiration":"2025-06-18T18:40:47.562981947Z","pruned":[]}
59662025-06-18T18:50:47.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
59672025-06-18T18:50:47.589ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59682025-06-18T18:50:47.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59692025-06-18T18:50:47.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
59702025-06-18T18:50:47.590ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
59712025-06-18T18:50:47.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
59722025-06-18T18:50:47.593ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59732025-06-18T18:50:47.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59742025-06-18T18:50:47.593ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59752025-06-18T18:50:47.594ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
59762025-06-18T18:50:47.594ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
59772025-06-18T18:50:47.594ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 31.241351ms iteration = 16 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
59782025-06-18T18:50:47.595ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59792025-06-18T18:50:47.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
59802025-06-18T18:50:47.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
59812025-06-18T18:50:47.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
59822025-06-18T18:50:47.599ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59832025-06-18T18:50:47.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
59842025-06-18T18:50:47.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59852025-06-18T18:50:47.601ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59862025-06-18T18:50:47.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59872025-06-18T18:50:47.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59882025-06-18T18:50:47.604ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
59892025-06-18T18:50:47.605ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
59902025-06-18T18:50:47.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
59912025-06-18T18:50:47.607ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
59922025-06-18T18:50:47.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
59932025-06-18T18:50:47.608ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59942025-06-18T18:50:47.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59952025-06-18T18:50:47.609ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59962025-06-18T18:50:47.609ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59972025-06-18T18:50:47.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59982025-06-18T18:50:47.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59992025-06-18T18:50:47.612ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60002025-06-18T18:50:47.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60012025-06-18T18:50:47.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60022025-06-18T18:50:47.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
60032025-06-18T18:50:47.616ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60042025-06-18T18:50:47.616ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 53.492758ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
60052025-06-18T18:50:47.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60062025-06-18T18:50:47.623ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60072025-06-18T18:50:47.623ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1837, tv_nsec: 200923269 } })
60082025-06-18T18:50:47.623ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
60092025-06-18T18:50:47.626ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
60102025-06-18T18:50:47.626ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
60112025-06-18T18:50:47.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
60122025-06-18T18:50:47.627ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60132025-06-18T18:50:47.628ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
60142025-06-18T18:50:47.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60152025-06-18T18:50:47.629ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
60162025-06-18T18:50:47.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
60172025-06-18T18:50:47.631ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60182025-06-18T18:50:47.632ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
60192025-06-18T18:50:47.632ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60202025-06-18T18:50:47.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60212025-06-18T18:50:47.632ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60222025-06-18T18:50:47.632ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
60232025-06-18T18:50:47.632ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60242025-06-18T18:50:47.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60252025-06-18T18:50:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
60262025-06-18T18:50:47.635ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60272025-06-18T18:50:47.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60282025-06-18T18:50:47.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60292025-06-18T18:50:47.638ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 75.749445ms iteration = 16 status = {"dispatched":[],"errors":[],"glob_version":"150.0.0","globs_reprocessed":{},"no_receivers":[]}
60302025-06-18T18:50:47.638ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 75.843106ms iteration = 31 status = {"errors":[],"requests_created_ok":[]}
60312025-06-18T18:50:47.638ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60322025-06-18T18:50:47.639ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60332025-06-18T18:50:47.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60342025-06-18T18:50:47.639ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60352025-06-18T18:50:47.640ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60362025-06-18T18:50:47.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60372025-06-18T18:50:47.642ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60382025-06-18T18:50:47.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60392025-06-18T18:50:47.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
60402025-06-18T18:50:47.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60412025-06-18T18:50:47.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60422025-06-18T18:50:47.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
60432025-06-18T18:50:47.644ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60442025-06-18T18:50:47.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60452025-06-18T18:50:47.644ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60462025-06-18T18:50:47.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
60472025-06-18T18:50:47.644ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60482025-06-18T18:50:47.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60492025-06-18T18:50:47.645ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 83.260628ms iteration = 31 status = {"errors":[],"finish_invoked_ok":[]}
60502025-06-18T18:50:47.646ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60512025-06-18T18:50:47.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
60522025-06-18T18:50:47.650ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60532025-06-18T18:50:47.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60542025-06-18T18:50:47.652ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60552025-06-18T18:50:47.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
60562025-06-18T18:50:47.652ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60572025-06-18T18:50:47.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60582025-06-18T18:50:47.653ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 90.905724ms iteration = 91 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60592025-06-18T18:50:47.655ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
60602025-06-18T18:50:47.655ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
60612025-06-18T18:50:47.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
60622025-06-18T18:50:47.656ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60632025-06-18T18:50:47.658ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
60642025-06-18T18:50:47.658ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
60652025-06-18T18:50:47.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
60662025-06-18T18:50:47.658ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60672025-06-18T18:50:47.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60682025-06-18T18:50:47.661ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60692025-06-18T18:50:47.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60702025-06-18T18:50:47.662ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60712025-06-18T18:50:47.662ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60722025-06-18T18:50:47.662ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
60732025-06-18T18:50:47.662ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60742025-06-18T18:50:47.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60752025-06-18T18:50:47.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60762025-06-18T18:50:47.663ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
60772025-06-18T18:50:47.663ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
60782025-06-18T18:50:47.663ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
60792025-06-18T18:50:47.663ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60802025-06-18T18:50:47.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60812025-06-18T18:50:47.665ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 102.637276ms iteration = 7 status = {"nsuccess":5}
60822025-06-18T18:50:47.668ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60832025-06-18T18:50:47.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60842025-06-18T18:50:47.672ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
60852025-06-18T18:50:47.672ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 109.166446ms iteration = 31 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
60862025-06-18T18:50:47.672ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
60872025-06-18T18:50:47.672ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
60882025-06-18T18:50:47.672ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
60892025-06-18T18:50:47.672ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60902025-06-18T18:50:47.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60912025-06-18T18:50:47.672ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60922025-06-18T18:50:47.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
60932025-06-18T18:50:47.676ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60942025-06-18T18:50:47.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60952025-06-18T18:50:47.682ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60962025-06-18T18:50:47.682ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60972025-06-18T18:50:47.682ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
60982025-06-18T18:50:47.682ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 121.323123ms iteration = 91 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
60992025-06-18T18:50:47.683ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
61002025-06-18T18:50:47.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
61012025-06-18T18:50:47.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61022025-06-18T18:50:47.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61032025-06-18T18:50:47.687ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
61042025-06-18T18:50:47.687ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 72dd4529-6655-4d30-a1d8-0de429d0133c dns_zone_name = oxide.test found_so_far = 0 version = 2
61052025-06-18T18:50:47.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61062025-06-18T18:50:47.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61072025-06-18T18:50:47.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61082025-06-18T18:50:47.688ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
61092025-06-18T18:50:47.688ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
61102025-06-18T18:50:47.688ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 125.324969ms iteration = 16 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
61112025-06-18T18:50:47.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
61122025-06-18T18:50:47.688ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61132025-06-18T18:50:47.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61142025-06-18T18:50:47.690ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61152025-06-18T18:50:47.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61162025-06-18T18:50:47.691ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61172025-06-18T18:50:47.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61182025-06-18T18:50:47.694ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61192025-06-18T18:50:47.695ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61202025-06-18T18:50:47.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61212025-06-18T18:50:47.695ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
61222025-06-18T18:50:47.695ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
61232025-06-18T18:50:47.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
61242025-06-18T18:50:47.696ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61252025-06-18T18:50:47.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61262025-06-18T18:50:47.697ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 72dd4529-6655-4d30-a1d8-0de429d0133c dns_zone_name = oxide.test found_so_far = 4 version = 2
61272025-06-18T18:50:47.697ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
61282025-06-18T18:50:47.697ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-18 18:36:20.010620 UTC dns_group = external generation = 2
61292025-06-18T18:50:47.697ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 135.298416ms iteration = 16 status = {"generation":2}
61302025-06-18T18:50:47.698ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61312025-06-18T18:50:47.701ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
61322025-06-18T18:50:47.701ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61332025-06-18T18:50:47.701ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8edff7cc-f8f8-47f6-9b8c-794443b468fb", "content-length": "26", "date": "Wed, 18 Jun 2025 18:50:47 GMT"} })
61342025-06-18T18:50:47.701ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61352025-06-18T18:50:47.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
61362025-06-18T18:50:47.701ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61372025-06-18T18:50:47.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61382025-06-18T18:50:47.703ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61392025-06-18T18:50:47.704ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 141.870327ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
61402025-06-18T18:50:47.704ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61412025-06-18T18:50:47.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61422025-06-18T18:50:47.706ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61432025-06-18T18:50:47.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61442025-06-18T18:50:47.706ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61452025-06-18T18:50:47.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61462025-06-18T18:50:47.707ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
61472025-06-18T18:50:47.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
61482025-06-18T18:50:47.708ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61492025-06-18T18:50:47.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61502025-06-18T18:50:47.709ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61512025-06-18T18:50:47.709ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61522025-06-18T18:50:47.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61532025-06-18T18:50:47.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61542025-06-18T18:50:47.709ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61552025-06-18T18:50:47.710ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61562025-06-18T18:50:47.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61572025-06-18T18:50:47.710ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 148.197115ms iteration = 31 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
61582025-06-18T18:50:47.710ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61592025-06-18T18:50:47.711ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61602025-06-18T18:50:47.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61612025-06-18T18:50:47.713ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
61622025-06-18T18:50:47.713ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
61632025-06-18T18:50:47.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
61642025-06-18T18:50:47.714ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61652025-06-18T18:50:47.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61662025-06-18T18:50:47.715ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61672025-06-18T18:50:47.715ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61682025-06-18T18:50:47.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61692025-06-18T18:50:47.715ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61702025-06-18T18:50:47.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9fbbc826-5b83-4b80-8172-66302c618aae, lookup_type: ById(9fbbc826-5b83-4b80-8172-66302c618aae) } result = Ok(())
61712025-06-18T18:50:47.716ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61722025-06-18T18:50:47.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61732025-06-18T18:50:47.716ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61742025-06-18T18:50:47.716ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
61752025-06-18T18:50:47.716ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 153.893043ms iteration = 32 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
61762025-06-18T18:50:47.717ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
61772025-06-18T18:50:47.717ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
61782025-06-18T18:50:47.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
61792025-06-18T18:50:47.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
61802025-06-18T18:50:47.719ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61812025-06-18T18:50:47.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61822025-06-18T18:50:47.720ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61832025-06-18T18:50:47.721ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 159.065995ms iteration = 31 status = 0
61842025-06-18T18:50:47.722ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
61852025-06-18T18:50:47.722ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
61862025-06-18T18:50:47.722ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61872025-06-18T18:50:47.723ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
61882025-06-18T18:50:47.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61892025-06-18T18:50:47.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
61902025-06-18T18:50:47.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
61912025-06-18T18:50:47.723ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
61922025-06-18T18:50:47.723ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61932025-06-18T18:50:47.723ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee0ecba3-3439-4314-b648-d262985756fa", "content-length": "26", "date": "Wed, 18 Jun 2025 18:50:47 GMT"} })
61942025-06-18T18:50:47.723ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61952025-06-18T18:50:47.724ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61962025-06-18T18:50:47.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61972025-06-18T18:50:47.725ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61982025-06-18T18:50:47.725ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61992025-06-18T18:50:47.726ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62002025-06-18T18:50:47.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62012025-06-18T18:50:47.728ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
62022025-06-18T18:50:47.728ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
62032025-06-18T18:50:47.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
62042025-06-18T18:50:47.730ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62052025-06-18T18:50:47.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62062025-06-18T18:50:47.735ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f zone_address = fd00:1122:3344:101::2
62072025-06-18T18:50:47.736ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62082025-06-18T18:50:47.736ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "054a2112-34b0-44d9-b021-66893e7dec72", "content-length": "26", "date": "Wed, 18 Jun 2025 18:50:47 GMT"} })
62092025-06-18T18:50:47.736ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62102025-06-18T18:50:47.739ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
62112025-06-18T18:50:47.740ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
62122025-06-18T18:50:47.740ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = ab8dd933-5e45-404d-97a3-fdafa1c7d91b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
62132025-06-18T18:50:47.740ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62142025-06-18T18:50:47.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62152025-06-18T18:50:47.746ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
62162025-06-18T18:50:47.746ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 183.687005ms iteration = 31 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
62172025-06-18T18:50:47.750ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62182025-06-18T18:50:47.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62192025-06-18T18:50:47.765ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-18T18:35:46.206089Z, time_modified: 2025-06-18T18:35:46.206089Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 472c0288-095b-456c-b18f-d5f22a8efd72, db_silo: Silo { identity: SiloIdentity { id: 472c0288-095b-456c-b18f-d5f22a8efd72, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-18T18:36:19.955323Z, time_modified: 2025-06-18T18:36:19.955323Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 472c0288-095b-456c-b18f-d5f22a8efd72, db_silo: Silo { identity: SiloIdentity { id: 472c0288-095b-456c-b18f-d5f22a8efd72, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-18T18:36:19.955323Z, time_modified: 2025-06-18T18:36:19.955323Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3" }] }) }
62202025-06-18T18:50:47.765ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 203.264005ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"472c0288-095b-456c-b18f-d5f22a8efd72","tls_certs":["6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3"]}},"default_endpoint":{"silo_id":"472c0288-095b-456c-b18f-d5f22a8efd72","tls_certs":["6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
62212025-06-18T18:50:47.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62222025-06-18T18:50:47.768ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
62232025-06-18T18:50:47.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
62242025-06-18T18:50:47.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
62252025-06-18T18:50:47.798ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 235.946775ms iteration = 34 status = {"physical_disks_added":0}
62262025-06-18T18:50:47.824ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
62272025-06-18T18:50:47.829ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
62282025-06-18T18:50:47.829ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 266.674119ms iteration = 16 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
62292025-06-18T18:50:47.832ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
62302025-06-18T18:50:47.832ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "cd288d7b-9983-4cda-af83-bcbc7b0ff7f0", "date": "Wed, 18 Jun 2025 18:50:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62312025-06-18T18:50:47.832ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62322025-06-18T18:50:47.834ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "bb99b745-c0f4-42ea-af88-e0a988d74506", "date": "Wed, 18 Jun 2025 18:50:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62332025-06-18T18:50:47.834ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62342025-06-18T18:50:47.836ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62352025-06-18T18:50:47.836ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 274.00119ms iteration = 18 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
62362025-06-18T18:50:47.870ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 308.631758ms iteration = 31 status = {}
62372025-06-18T18:50:47.898ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62382025-06-18T18:50:47.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62392025-06-18T18:50:47.905ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
62402025-06-18T18:50:47.905ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62412025-06-18T18:50:47.906ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fb2eb4b-9342-43d3-a2db-752b0de0564a", "content-length": "372", "date": "Wed, 18 Jun 2025 18:50:47 GMT"} })
62422025-06-18T18:50:47.906ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62432025-06-18T18:50:47.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62442025-06-18T18:50:47.908ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62452025-06-18T18:50:47.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62462025-06-18T18:50:47.954ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
62472025-06-18T18:50:47.955ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "476d35f8-7957-4815-8fa8-ab9641a9781c", "date": "Wed, 18 Jun 2025 18:50:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
62482025-06-18T18:50:47.955ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
62492025-06-18T18:50:47.957ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "02fd79f6-4b22-4baa-b1dd-4450c36027f8", "date": "Wed, 18 Jun 2025 18:50:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
62502025-06-18T18:50:47.957ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
62512025-06-18T18:50:47.958ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "19b3f5d7-836d-4bcd-a9b7-08378bc2600e", "date": "Wed, 18 Jun 2025 18:50:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
62522025-06-18T18:50:47.958ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
62532025-06-18T18:50:47.960ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
62542025-06-18T18:50:47.960ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 399.295729ms iteration = 18 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
62552025-06-18T18:50:47.988ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
62562025-06-18T18:50:47.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
62572025-06-18T18:50:47.990ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62582025-06-18T18:50:47.992ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
62592025-06-18T18:50:47.992ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 429.791969ms iteration = 7 status = {"blueprint_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","inventory_collection_id":"67698947-dda3-4a68-ac01-6b563c4a13b9","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
62602025-06-18T18:50:47.992ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 430.210505ms iteration = 31 status = null
62612025-06-18T18:50:47.993ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62622025-06-18T18:50:47.993ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62632025-06-18T18:50:47.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62642025-06-18T18:50:47.995ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62652025-06-18T18:50:47.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62662025-06-18T18:50:47.997ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = ab8dd933-5e45-404d-97a3-fdafa1c7d91b dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
62672025-06-18T18:50:47.997ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
62682025-06-18T18:50:47.997ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-18 18:36:19.303122 UTC dns_group = internal generation = 1
62692025-06-18T18:50:47.997ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 434.516035ms iteration = 16 status = {"generation":1}
62702025-06-18T18:50:48.028ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62712025-06-18T18:50:48.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62722025-06-18T18:50:48.030ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62732025-06-18T18:50:48.032ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
62742025-06-18T18:50:48.032ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
62752025-06-18T18:50:48.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
62762025-06-18T18:50:48.034ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
62772025-06-18T18:50:48.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
62782025-06-18T18:50:48.041ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
62792025-06-18T18:50:48.041ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
62802025-06-18T18:50:48.041ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1f53c07e-557a-43b7-9332-7c4164d2ccd6", "date": "Wed, 18 Jun 2025 18:50:47 GMT"} })
62812025-06-18T18:50:48.041ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62822025-06-18T18:50:48.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62832025-06-18T18:50:48.043ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62842025-06-18T18:50:48.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62852025-06-18T18:50:48.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62862025-06-18T18:50:48.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62872025-06-18T18:50:48.046ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62882025-06-18T18:50:48.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62892025-06-18T18:50:48.047ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 7e1ff921-047f-464e-8081-f8132af716ac, rack_id: 3a330d2e-6212-46a4-9781-374fdb3dc92f, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(6c07c314-d66b-4041-9040-d774200d26a9) } rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
62902025-06-18T18:50:48.047ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62912025-06-18T18:50:48.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62922025-06-18T18:50:48.049ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
62932025-06-18T18:50:48.049ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62942025-06-18T18:50:48.050ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6cb11423-52a3-48b0-9e9d-cdc134ea346c", "date": "Wed, 18 Jun 2025 18:50:47 GMT"} })
62952025-06-18T18:50:48.051ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 489.465663ms iteration = 32 status = {}
62962025-06-18T18:50:48.066ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
62972025-06-18T18:50:48.066ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 6c07c314-d66b-4041-9040-d774200d26a9
62982025-06-18T18:50:48.067ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
62992025-06-18T18:50:48.067ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63002025-06-18T18:50:48.067ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63012025-06-18T18:50:48.067ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63022025-06-18T18:50:48.067ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63032025-06-18T18:50:48.067ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63042025-06-18T18:50:48.067ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63052025-06-18T18:50:48.067ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63062025-06-18T18:50:48.067ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
63072025-06-18T18:50:48.067ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63082025-06-18T18:50:48.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63092025-06-18T18:50:48.069ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63102025-06-18T18:50:48.070ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
63112025-06-18T18:50:48.070ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
63122025-06-18T18:50:48.075ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
63132025-06-18T18:50:48.075ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63142025-06-18T18:50:48.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63152025-06-18T18:50:48.076ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63162025-06-18T18:50:48.077ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63172025-06-18T18:50:48.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63182025-06-18T18:50:48.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
63192025-06-18T18:50:48.078ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
63202025-06-18T18:50:48.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
63212025-06-18T18:50:48.080ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/artifacts-config
63222025-06-18T18:50:48.094ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63232025-06-18T18:50:48.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63242025-06-18T18:50:48.096ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63252025-06-18T18:50:48.098ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63262025-06-18T18:50:48.098ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63272025-06-18T18:50:48.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63282025-06-18T18:50:48.099ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63292025-06-18T18:50:48.101ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63302025-06-18T18:50:48.101ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63312025-06-18T18:50:48.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63322025-06-18T18:50:48.111ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63332025-06-18T18:50:48.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63342025-06-18T18:50:48.134ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
63352025-06-18T18:50:48.145ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63362025-06-18T18:50:48.148ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
63372025-06-18T18:50:48.148ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63382025-06-18T18:50:48.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63392025-06-18T18:50:48.153ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63402025-06-18T18:50:48.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63412025-06-18T18:50:48.155ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63422025-06-18T18:50:48.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63432025-06-18T18:50:48.157ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63442025-06-18T18:50:48.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63452025-06-18T18:50:48.159ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63462025-06-18T18:50:48.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63472025-06-18T18:50:48.161ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63482025-06-18T18:50:48.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63492025-06-18T18:50:48.162ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63502025-06-18T18:50:48.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63512025-06-18T18:50:48.164ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63522025-06-18T18:50:48.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63532025-06-18T18:50:48.166ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63542025-06-18T18:50:48.169ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
63552025-06-18T18:50:48.169ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63562025-06-18T18:50:48.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63572025-06-18T18:50:48.171ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63582025-06-18T18:50:48.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63592025-06-18T18:50:48.172ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63602025-06-18T18:50:48.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63612025-06-18T18:50:48.173ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63622025-06-18T18:50:48.177ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e32fabb9-ae3b-4028-8faf-029684b4d2d6", "date": "Wed, 18 Jun 2025 18:50:47 GMT"} })
63632025-06-18T18:50:48.177ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch = Switch0
63642025-06-18T18:50:48.177ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
63652025-06-18T18:50:48.177ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "967f37d5-5567-4cb2-917f-2927cff486fa", "content-length": "682", "date": "Wed, 18 Jun 2025 18:50:47 GMT"} })
63662025-06-18T18:50:48.177ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63672025-06-18T18:50:48.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63682025-06-18T18:50:48.178ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
63692025-06-18T18:50:48.178ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63702025-06-18T18:50:48.178ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "78b0d883-ba7f-471f-b7ec-1643e4c6e4d6", "content-length": "691", "date": "Wed, 18 Jun 2025 18:50:48 GMT"} })
63712025-06-18T18:50:48.178ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
63722025-06-18T18:50:48.178ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
63732025-06-18T18:50:48.178ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
63742025-06-18T18:50:48.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63752025-06-18T18:50:48.178ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts-config", status: 204, headers: {"x-request-id": "d1bb2bb4-9512-4aec-a2f4-3b653fd62512", "date": "Wed, 18 Jun 2025 18:50:48 GMT"} })
63762025-06-18T18:50:48.179ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
63772025-06-18T18:50:48.179ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c4381b3-6d9a-49cb-96d7-3fd516f7ee68", "content-length": "26", "date": "Wed, 18 Jun 2025 18:50:48 GMT"} })
63782025-06-18T18:50:48.179ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:669 sled = http://[fd00:1122:3344:101::1]:12345
63792025-06-18T18:50:48.179ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 617.392338ms iteration = 32 status = {}
63802025-06-18T18:50:48.180ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63812025-06-18T18:50:48.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63822025-06-18T18:50:48.181ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 618.719115ms iteration = 4 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":3,"put_config_err":0,"put_config_ok":3,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"9fbbc826-5b83-4b80-8172-66302c618aae","time":"2025-06-18T18:40:48.065222500Z"},{"operation":"list","target_sled":"9fbbc826-5b83-4b80-8172-66302c618aae","time":"2025-06-18T18:40:48.073988061Z"},{"generation":1,"operation":"put_config","target_sled":"9fbbc826-5b83-4b80-8172-66302c618aae","time":"2025-06-18T18:45:48.140141520Z"},{"operation":"list","target_sled":"9fbbc826-5b83-4b80-8172-66302c618aae","time":"2025-06-18T18:45:48.140424074Z"},{"generation":1,"operation":"put_config","target_sled":"9fbbc826-5b83-4b80-8172-66302c618aae","time":"2025-06-18T18:50:48.178983116Z"},{"operation":"list","target_sled":"9fbbc826-5b83-4b80-8172-66302c618aae","time":"2025-06-18T18:50:48.179312602Z"}]}
63832025-06-18T18:50:48.183ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63842025-06-18T18:50:48.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63852025-06-18T18:50:48.184ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 4c3f65cf-097e-4f7f-bcbd-fe4a69c72380, kind: Service { id: 800703b5-0601-4ce2-acc3-d5b9ca473160 }, name: Name("external-dns-800703b5-0601-4ce2-acc3-d5b9ca473160"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 125])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8257c735-9403-467d-ab2e-1949faf5e7da, kind: Service { id: 03fce462-e4e1-4a86-890b-8a2ae9e17168 }, name: Name("external-dns-03fce462-e4e1-4a86-890b-8a2ae9e17168"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 1b4a3441-8faf-4189-b360-7390987e22a5, kind: Service { id: bc9fb17d-ee0d-4316-a104-8c90282fc043 }, name: Name("nexus-bc9fb17d-ee0d-4316-a104-8c90282fc043"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 17])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bd40f9d4-e706-42d1-8343-14cc7ebb9a67, kind: Service { id: bd650381-2ec2-42b7-9e94-5fda37d951b8 }, name: Name("nexus-bd650381-2ec2-42b7-9e94-5fda37d951b8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 116])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e32c28c4-67a7-4997-8fc5-f30c60e72322, kind: Service { id: 8be6515c-b7f8-4e94-8553-063002d39ea6 }, name: Name("nexus-8be6515c-b7f8-4e94-8553-063002d39ea6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
63862025-06-18T18:50:48.184ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63872025-06-18T18:50:48.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63882025-06-18T18:50:48.185ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63892025-06-18T18:50:48.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63902025-06-18T18:50:48.186ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63912025-06-18T18:50:48.188ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
63922025-06-18T18:50:48.188ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63932025-06-18T18:50:48.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63942025-06-18T18:50:48.192ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 629.548685ms iteration = 31 status = {}
63952025-06-18T18:50:48.285ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
63962025-06-18T18:50:48.285ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 4c3f65cf-097e-4f7f-bcbd-fe4a69c72380, kind: Service { id: 800703b5-0601-4ce2-acc3-d5b9ca473160 }, name: Name("external-dns-800703b5-0601-4ce2-acc3-d5b9ca473160"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 125])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8257c735-9403-467d-ab2e-1949faf5e7da, kind: Service { id: 03fce462-e4e1-4a86-890b-8a2ae9e17168 }, name: Name("external-dns-03fce462-e4e1-4a86-890b-8a2ae9e17168"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 201, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 1b4a3441-8faf-4189-b360-7390987e22a5, kind: Service { id: bc9fb17d-ee0d-4316-a104-8c90282fc043 }, name: Name("nexus-bc9fb17d-ee0d-4316-a104-8c90282fc043"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 17])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bd40f9d4-e706-42d1-8343-14cc7ebb9a67, kind: Service { id: bd650381-2ec2-42b7-9e94-5fda37d951b8 }, name: Name("nexus-bd650381-2ec2-42b7-9e94-5fda37d951b8"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 116])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e32c28c4-67a7-4997-8fc5-f30c60e72322, kind: Service { id: 8be6515c-b7f8-4e94-8553-063002d39ea6 }, name: Name("nexus-8be6515c-b7f8-4e94-8553-063002d39ea6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 168])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
63972025-06-18T18:50:48.285ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
63982025-06-18T18:50:48.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b365c77f-8122-4e74-a755-714dd5d7a65a roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
63992025-06-18T18:50:48.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b365c77f-8122-4e74-a755-714dd5d7a65a resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64002025-06-18T18:50:48.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3232 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b365c77f-8122-4e74-a755-714dd5d7a65a response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64012025-06-18T18:50:48.517ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 9fbbc826-5b83-4b80-8172-66302c618aae, time_created: 2025-06-18T18:36:18.987238Z, time_modified: 2025-06-18T18:36:18.987238Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 3a330d2e-6212-46a4-9781-374fdb3dc92f, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(56094621696)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
64022025-06-18T18:50:48.517ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
64032025-06-18T18:50:48.549ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64042025-06-18T18:50:48.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64052025-06-18T18:50:48.552ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64062025-06-18T18:50:48.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64072025-06-18T18:50:48.555ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64082025-06-18T18:50:48.560ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 9fbbc826-5b83-4b80-8172-66302c618aae, lookup_type: ById(9fbbc826-5b83-4b80-8172-66302c618aae) } result = Ok(())
64092025-06-18T18:50:48.560ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
64102025-06-18T18:50:48.561ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "998c4ac2-33d7-4d57-b6cd-5b1a645dad51", "date": "Wed, 18 Jun 2025 18:50:48 GMT"} })
64112025-06-18T18:50:48.562ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:495
64122025-06-18T18:50:48.562ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 1.000034106s
64132025-06-18T18:50:48.562ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 1.000046496s iteration = 4 status = {}
64142025-06-18T18:50:49.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 71a8ab7f-8c15-4f93-92bb-e8eb02086b38 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64152025-06-18T18:50:49.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 71a8ab7f-8c15-4f93-92bb-e8eb02086b38 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64162025-06-18T18:50:49.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2707 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 71a8ab7f-8c15-4f93-92bb-e8eb02086b38 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64172025-06-18T18:50:50.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f21d221c-7a57-453a-970d-86f82929c5dd roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64182025-06-18T18:50:50.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f21d221c-7a57-453a-970d-86f82929c5dd resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64192025-06-18T18:50:50.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2610 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f21d221c-7a57-453a-970d-86f82929c5dd response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64202025-06-18T18:50:51.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58243 req_id = 22eb8331-c76b-496d-bafd-0a977a60aa50 roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
64212025-06-18T18:50:51.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58243 req_id = 22eb8331-c76b-496d-bafd-0a977a60aa50 resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
64222025-06-18T18:50:51.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3250 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58243 req_id = 22eb8331-c76b-496d-bafd-0a977a60aa50 response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
64232025-06-18T18:50:51.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58243 req_id = e176a0b0-996f-43f5-b857-e75fc1c3c172 roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
64242025-06-18T18:50:51.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58243 req_id = e176a0b0-996f-43f5-b857-e75fc1c3c172 resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
64252025-06-18T18:50:51.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2411 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58243 req_id = e176a0b0-996f-43f5-b857-e75fc1c3c172 response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
64262025-06-18T18:50:51.135ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 635 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 7a011013-1671-4ec4-a363-a6863303d1fd response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
64272025-06-18T18:50:51.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = dba629f7-de7a-4474-937a-10161f877c72 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64282025-06-18T18:50:51.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = dba629f7-de7a-4474-937a-10161f877c72 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64292025-06-18T18:50:51.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2759 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = dba629f7-de7a-4474-937a-10161f877c72 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64302025-06-18T18:50:52.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 096093d0-92d4-46f6-8e06-a74c70abce27 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64312025-06-18T18:50:52.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 096093d0-92d4-46f6-8e06-a74c70abce27 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64322025-06-18T18:50:52.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2440 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 096093d0-92d4-46f6-8e06-a74c70abce27 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64332025-06-18T18:50:53.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4202276e-9e38-4b2f-b512-a570e89aa974 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64342025-06-18T18:50:53.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4202276e-9e38-4b2f-b512-a570e89aa974 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64352025-06-18T18:50:53.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2001 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4202276e-9e38-4b2f-b512-a570e89aa974 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64362025-06-18T18:50:54.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5e5f9e06-d1ed-4c9a-ab8f-827c47b83856 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64372025-06-18T18:50:54.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5e5f9e06-d1ed-4c9a-ab8f-827c47b83856 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64382025-06-18T18:50:54.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2434 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5e5f9e06-d1ed-4c9a-ab8f-827c47b83856 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64392025-06-18T18:50:55.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 852406ee-c834-4e9d-92a1-2939f19ecb00 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64402025-06-18T18:50:55.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 852406ee-c834-4e9d-92a1-2939f19ecb00 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64412025-06-18T18:50:55.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2672 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 852406ee-c834-4e9d-92a1-2939f19ecb00 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64422025-06-18T18:50:56.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 336bf95e-5e8f-485b-80ec-52818a474104 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64432025-06-18T18:50:56.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 336bf95e-5e8f-485b-80ec-52818a474104 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64442025-06-18T18:50:56.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2877 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 336bf95e-5e8f-485b-80ec-52818a474104 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64452025-06-18T18:50:57.561ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 92 reason = Timeout
64462025-06-18T18:50:57.561ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 92 reason = Timeout
64472025-06-18T18:50:57.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64482025-06-18T18:50:57.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64492025-06-18T18:50:57.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64502025-06-18T18:50:57.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64512025-06-18T18:50:57.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c0fb8b53-381e-436f-8c5b-4f465a46edb6 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64522025-06-18T18:50:57.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c0fb8b53-381e-436f-8c5b-4f465a46edb6 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64532025-06-18T18:50:57.564ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64542025-06-18T18:50:57.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64552025-06-18T18:50:57.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64562025-06-18T18:50:57.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2463 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c0fb8b53-381e-436f-8c5b-4f465a46edb6 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64572025-06-18T18:50:57.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64582025-06-18T18:50:57.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64592025-06-18T18:50:57.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64602025-06-18T18:50:57.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64612025-06-18T18:50:57.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64622025-06-18T18:50:57.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64632025-06-18T18:50:57.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
64642025-06-18T18:50:57.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64652025-06-18T18:50:57.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64662025-06-18T18:50:57.584ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
64672025-06-18T18:50:57.584ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.20316ms iteration = 92 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
64682025-06-18T18:50:57.597ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.559681ms iteration = 92 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64692025-06-18T18:50:58.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 2ed0ec3f-c0a4-4790-b756-401bad5c143d roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64702025-06-18T18:50:58.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 2ed0ec3f-c0a4-4790-b756-401bad5c143d resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64712025-06-18T18:50:58.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2146 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 2ed0ec3f-c0a4-4790-b756-401bad5c143d response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64722025-06-18T18:50:59.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3c01aff1-d29d-485f-a641-8696fbfe7b55 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64732025-06-18T18:50:59.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3c01aff1-d29d-485f-a641-8696fbfe7b55 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64742025-06-18T18:50:59.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2434 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 3c01aff1-d29d-485f-a641-8696fbfe7b55 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64752025-06-18T18:51:00.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 219b01a8-3f64-4f1a-9293-fc29d96fc9ba roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64762025-06-18T18:51:00.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 219b01a8-3f64-4f1a-9293-fc29d96fc9ba resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64772025-06-18T18:51:00.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2388 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 219b01a8-3f64-4f1a-9293-fc29d96fc9ba response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64782025-06-18T18:51:01.136ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 939 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = a85cd096-2895-44fe-8372-704ef9ee69b8 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
64792025-06-18T18:51:01.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e4ed4684-b2d8-4a2c-8d6a-855d3156b966 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64802025-06-18T18:51:01.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e4ed4684-b2d8-4a2c-8d6a-855d3156b966 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64812025-06-18T18:51:01.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3009 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e4ed4684-b2d8-4a2c-8d6a-855d3156b966 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64822025-06-18T18:51:02.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 70e303eb-e9fc-4af2-8a6d-70b9388c507f roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64832025-06-18T18:51:02.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 70e303eb-e9fc-4af2-8a6d-70b9388c507f resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64842025-06-18T18:51:02.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2280 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 70e303eb-e9fc-4af2-8a6d-70b9388c507f response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64852025-06-18T18:51:03.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 28156b77-6bf6-4ce4-8c84-5a2050b9a773 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64862025-06-18T18:51:03.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 28156b77-6bf6-4ce4-8c84-5a2050b9a773 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64872025-06-18T18:51:03.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2622 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 28156b77-6bf6-4ce4-8c84-5a2050b9a773 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64882025-06-18T18:51:04.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8291b49e-0ad1-49fe-9af7-452ccaeacef9 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64892025-06-18T18:51:04.677ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8291b49e-0ad1-49fe-9af7-452ccaeacef9 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64902025-06-18T18:51:04.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2842 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8291b49e-0ad1-49fe-9af7-452ccaeacef9 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64912025-06-18T18:51:05.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9eeb4751-abba-4d52-b99b-fd50b0d1a05e roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64922025-06-18T18:51:05.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9eeb4751-abba-4d52-b99b-fd50b0d1a05e resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64932025-06-18T18:51:05.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2046 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9eeb4751-abba-4d52-b99b-fd50b0d1a05e response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64942025-06-18T18:51:06.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c725d1a0-8fa1-4f00-9478-ca2cfad2b49a roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64952025-06-18T18:51:06.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c725d1a0-8fa1-4f00-9478-ca2cfad2b49a resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64962025-06-18T18:51:06.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2462 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = c725d1a0-8fa1-4f00-9478-ca2cfad2b49a response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
64972025-06-18T18:51:07.561ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 93 reason = Timeout
64982025-06-18T18:51:07.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64992025-06-18T18:51:07.561ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 93 reason = Timeout
65002025-06-18T18:51:07.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65012025-06-18T18:51:07.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65022025-06-18T18:51:07.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65032025-06-18T18:51:07.563ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65042025-06-18T18:51:07.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65052025-06-18T18:51:07.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65062025-06-18T18:51:07.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65072025-06-18T18:51:07.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65082025-06-18T18:51:07.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65092025-06-18T18:51:07.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65102025-06-18T18:51:07.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
65112025-06-18T18:51:07.573ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65122025-06-18T18:51:07.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65132025-06-18T18:51:07.583ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
65142025-06-18T18:51:07.583ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.800331ms iteration = 93 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
65152025-06-18T18:51:07.595ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65162025-06-18T18:51:07.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65172025-06-18T18:51:07.627ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.9773ms iteration = 93 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65182025-06-18T18:51:07.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 86e85c3e-5c51-4877-ae7b-79acf515ca31 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65192025-06-18T18:51:07.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 86e85c3e-5c51-4877-ae7b-79acf515ca31 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65202025-06-18T18:51:07.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1877 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 86e85c3e-5c51-4877-ae7b-79acf515ca31 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65212025-06-18T18:51:08.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 39cd7e0b-d2ab-471f-99be-2d7340713127 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65222025-06-18T18:51:08.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 39cd7e0b-d2ab-471f-99be-2d7340713127 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65232025-06-18T18:51:08.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2365 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 39cd7e0b-d2ab-471f-99be-2d7340713127 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65242025-06-18T18:51:09.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a81f534f-0cf5-4d29-9050-c751088e07d0 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65252025-06-18T18:51:09.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a81f534f-0cf5-4d29-9050-c751088e07d0 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65262025-06-18T18:51:09.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2418 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a81f534f-0cf5-4d29-9050-c751088e07d0 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65272025-06-18T18:51:10.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 52380f7c-92ef-49d3-96cd-c8e5bcbe9d2f roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65282025-06-18T18:51:10.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 52380f7c-92ef-49d3-96cd-c8e5bcbe9d2f resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65292025-06-18T18:51:10.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2553 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 52380f7c-92ef-49d3-96cd-c8e5bcbe9d2f response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65302025-06-18T18:51:11.135ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 627 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 20549d29-e86a-44d8-b86e-a5f0ca221610 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
65312025-06-18T18:51:11.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9dee379e-dc49-49f8-8ef8-ab81866546f2 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65322025-06-18T18:51:11.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9dee379e-dc49-49f8-8ef8-ab81866546f2 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65332025-06-18T18:51:11.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2505 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 9dee379e-dc49-49f8-8ef8-ab81866546f2 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65342025-06-18T18:51:12.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = de679ba5-3b9d-4c6b-a315-f1f17e560b9f roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65352025-06-18T18:51:12.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = de679ba5-3b9d-4c6b-a315-f1f17e560b9f resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65362025-06-18T18:51:12.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2227 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = de679ba5-3b9d-4c6b-a315-f1f17e560b9f response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65372025-06-18T18:51:13.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 80596b82-9461-4204-9767-4486f7d2f96d roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65382025-06-18T18:51:13.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 80596b82-9461-4204-9767-4486f7d2f96d resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65392025-06-18T18:51:13.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2350 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 80596b82-9461-4204-9767-4486f7d2f96d response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65402025-06-18T18:51:14.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 022a5b77-9774-43be-a863-5394b308ba9c roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65412025-06-18T18:51:14.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 022a5b77-9774-43be-a863-5394b308ba9c resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65422025-06-18T18:51:14.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2569 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 022a5b77-9774-43be-a863-5394b308ba9c response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65432025-06-18T18:51:15.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5d3a2d09-5878-4c9c-98eb-eb1aedb67f2c roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65442025-06-18T18:51:15.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5d3a2d09-5878-4c9c-98eb-eb1aedb67f2c resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65452025-06-18T18:51:15.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2432 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5d3a2d09-5878-4c9c-98eb-eb1aedb67f2c response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65462025-06-18T18:51:16.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 044a4ab1-e8c7-4cb8-ab52-28210c571bdf roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65472025-06-18T18:51:16.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 044a4ab1-e8c7-4cb8-ab52-28210c571bdf resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65482025-06-18T18:51:16.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2191 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 044a4ab1-e8c7-4cb8-ab52-28210c571bdf response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
65492025-06-18T18:51:17.561ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 94 reason = Timeout
65502025-06-18T18:51:17.561ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 33 reason = Timeout
65512025-06-18T18:51:17.561ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
65522025-06-18T18:51:17.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65532025-06-18T18:51:17.561ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65542025-06-18T18:51:17.561ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 32 reason = Timeout
65552025-06-18T18:51:17.561ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
65562025-06-18T18:51:17.561ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 32 reason = Timeout
65572025-06-18T18:51:17.561ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 32 reason = Timeout
65582025-06-18T18:51:17.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65592025-06-18T18:51:17.561ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65602025-06-18T18:51:17.561ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 32 reason = Timeout
65612025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
65622025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 32 reason = Timeout
65632025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65642025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 32 reason = Timeout
65652025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65662025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 33 reason = Timeout
65672025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65682025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 32 reason = Timeout
65692025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
65702025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 32 reason = Timeout
65712025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65722025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 32 reason = Timeout
65732025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65742025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 33 reason = Timeout
65752025-06-18T18:51:17.562ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
65762025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 32 reason = Timeout
65772025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
65782025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 32 reason = Timeout
65792025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65802025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 94 reason = Timeout
65812025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65822025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 32 reason = Timeout
65832025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65842025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 35 reason = Timeout
65852025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65862025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 32 reason = Timeout
65872025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
65882025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65892025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65902025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
65912025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
65922025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65932025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65942025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65952025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
65962025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65972025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65982025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65992025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
66002025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66012025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66022025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66032025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66042025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66052025-06-18T18:51:17.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
66062025-06-18T18:51:17.566ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.36143ms iteration = 32 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
66072025-06-18T18:51:17.570ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1867, tv_nsec: 147808338 } })
66082025-06-18T18:51:17.570ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
66092025-06-18T18:51:17.580ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1867, tv_nsec: 157410501 } })
66102025-06-18T18:51:17.580ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
66112025-06-18T18:51:17.606ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 44.17569ms iteration = 32 status = {"errors":[],"requests_created_ok":[]}
66122025-06-18T18:51:17.608ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66132025-06-18T18:51:17.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66142025-06-18T18:51:17.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66152025-06-18T18:51:17.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66162025-06-18T18:51:17.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66172025-06-18T18:51:17.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66182025-06-18T18:51:17.611ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66192025-06-18T18:51:17.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
66202025-06-18T18:51:17.612ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66212025-06-18T18:51:17.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66222025-06-18T18:51:17.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66232025-06-18T18:51:17.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.785635ms iteration = 32 status = {"errors":[],"finish_invoked_ok":[]}
66242025-06-18T18:51:17.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
66252025-06-18T18:51:17.614ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
66262025-06-18T18:51:17.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
66272025-06-18T18:51:17.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
66282025-06-18T18:51:17.614ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66292025-06-18T18:51:17.614ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66302025-06-18T18:51:17.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66312025-06-18T18:51:17.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66322025-06-18T18:51:17.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
66332025-06-18T18:51:17.616ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66342025-06-18T18:51:17.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66352025-06-18T18:51:17.616ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66362025-06-18T18:51:17.616ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
66372025-06-18T18:51:17.616ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66382025-06-18T18:51:17.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66392025-06-18T18:51:17.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66402025-06-18T18:51:17.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66412025-06-18T18:51:17.618ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1867, tv_nsec: 195959263 } })
66422025-06-18T18:51:17.618ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66432025-06-18T18:51:17.618ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
66442025-06-18T18:51:17.618ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66452025-06-18T18:51:17.619ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
66462025-06-18T18:51:17.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66472025-06-18T18:51:17.620ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66482025-06-18T18:51:17.622ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66492025-06-18T18:51:17.622ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66502025-06-18T18:51:17.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66512025-06-18T18:51:17.624ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66522025-06-18T18:51:17.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66532025-06-18T18:51:17.625ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66542025-06-18T18:51:17.626ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66552025-06-18T18:51:17.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66562025-06-18T18:51:17.630ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66572025-06-18T18:51:17.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66582025-06-18T18:51:17.630ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66592025-06-18T18:51:17.630ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66602025-06-18T18:51:17.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66612025-06-18T18:51:17.631ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 69.56306ms iteration = 32 status = {"errors":[],"garbage_collect_requested":[]}
66622025-06-18T18:51:17.632ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66632025-06-18T18:51:17.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66642025-06-18T18:51:17.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66652025-06-18T18:51:17.636ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66662025-06-18T18:51:17.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66672025-06-18T18:51:17.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66682025-06-18T18:51:17.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66692025-06-18T18:51:17.639ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66702025-06-18T18:51:17.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66712025-06-18T18:51:17.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66722025-06-18T18:51:17.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66732025-06-18T18:51:17.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66742025-06-18T18:51:17.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66752025-06-18T18:51:17.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
66762025-06-18T18:51:17.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66772025-06-18T18:51:17.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66782025-06-18T18:51:17.651ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
66792025-06-18T18:51:17.651ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
66802025-06-18T18:51:17.651ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "54be4474-c755-47bc-b4a5-52536b5aa6ad", "content-length": "26", "date": "Wed, 18 Jun 2025 18:51:17 GMT"} })
66812025-06-18T18:51:17.651ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
66822025-06-18T18:51:17.654ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
66832025-06-18T18:51:17.658ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 96.190868ms iteration = 94 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66842025-06-18T18:51:17.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.930102ms iteration = 32 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66852025-06-18T18:51:17.660ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
66862025-06-18T18:51:17.660ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 98.058333ms iteration = 94 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
66872025-06-18T18:51:17.660ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66882025-06-18T18:51:17.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66892025-06-18T18:51:17.661ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 99.062127ms iteration = 32 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66902025-06-18T18:51:17.663ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66912025-06-18T18:51:17.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66922025-06-18T18:51:17.664ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66932025-06-18T18:51:17.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9fbbc826-5b83-4b80-8172-66302c618aae, lookup_type: ById(9fbbc826-5b83-4b80-8172-66302c618aae) } result = Ok(())
66942025-06-18T18:51:17.669ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66952025-06-18T18:51:17.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66962025-06-18T18:51:17.670ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
66972025-06-18T18:51:17.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
66982025-06-18T18:51:17.671ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
66992025-06-18T18:51:17.671ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 110.018598ms iteration = 32 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
67002025-06-18T18:51:17.672ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 109.908687ms iteration = 32 status = 0
67012025-06-18T18:51:17.672ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67022025-06-18T18:51:17.672ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67032025-06-18T18:51:17.672ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
67042025-06-18T18:51:17.672ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 110.983711ms iteration = 33 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
67052025-06-18T18:51:17.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
67062025-06-18T18:51:17.674ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
67072025-06-18T18:51:17.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
67082025-06-18T18:51:17.677ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67092025-06-18T18:51:17.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67102025-06-18T18:51:17.686ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
67112025-06-18T18:51:17.686ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67122025-06-18T18:51:17.687ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 124.903423ms iteration = 35 status = {"physical_disks_added":0}
67132025-06-18T18:51:17.687ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5da04e48-4bc1-4da1-ba49-9603d684813c", "content-length": "26", "date": "Wed, 18 Jun 2025 18:51:17 GMT"} })
67142025-06-18T18:51:17.687ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67152025-06-18T18:51:17.690ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67162025-06-18T18:51:17.700ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67172025-06-18T18:51:17.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67182025-06-18T18:51:17.713ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
67192025-06-18T18:51:17.713ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 151.079095ms iteration = 32 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
67202025-06-18T18:51:17.718ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 156.467098ms iteration = 32 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
67212025-06-18T18:51:17.721ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f zone_address = fd00:1122:3344:101::2
67222025-06-18T18:51:17.721ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67232025-06-18T18:51:17.721ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5257ea57-9c9a-42a5-9540-9a014efd58a4", "content-length": "26", "date": "Wed, 18 Jun 2025 18:51:17 GMT"} })
67242025-06-18T18:51:17.721ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67252025-06-18T18:51:17.724ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
67262025-06-18T18:51:17.741ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67272025-06-18T18:51:17.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67282025-06-18T18:51:17.743ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 181.423163ms iteration = 32 status = null
67292025-06-18T18:51:17.777ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 215.455602ms iteration = 32 status = {}
67302025-06-18T18:51:17.791ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
67312025-06-18T18:51:17.791ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67322025-06-18T18:51:17.792ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d686dd2-21ad-4ac1-8d13-792962eab2e7", "content-length": "372", "date": "Wed, 18 Jun 2025 18:51:17 GMT"} })
67332025-06-18T18:51:17.792ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67342025-06-18T18:51:17.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67352025-06-18T18:51:17.798ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67362025-06-18T18:51:17.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67372025-06-18T18:51:17.799ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67382025-06-18T18:51:17.801ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67392025-06-18T18:51:17.801ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67402025-06-18T18:51:17.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67412025-06-18T18:51:17.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67422025-06-18T18:51:17.805ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67432025-06-18T18:51:17.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67442025-06-18T18:51:17.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67452025-06-18T18:51:17.843ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
67462025-06-18T18:51:17.843ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
67472025-06-18T18:51:17.843ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f2579eb7-2140-4491-8577-cc762fb27a86", "date": "Wed, 18 Jun 2025 18:51:17 GMT"} })
67482025-06-18T18:51:17.843ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67492025-06-18T18:51:17.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67502025-06-18T18:51:17.846ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67512025-06-18T18:51:17.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67522025-06-18T18:51:17.849ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67532025-06-18T18:51:17.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67542025-06-18T18:51:17.853ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
67552025-06-18T18:51:17.853ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67562025-06-18T18:51:17.853ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "04706826-d5e4-4d4d-99ac-4151dcd29c4d", "date": "Wed, 18 Jun 2025 18:51:17 GMT"} })
67572025-06-18T18:51:17.855ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 293.449409ms iteration = 33 status = {}
67582025-06-18T18:51:17.865ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
67592025-06-18T18:51:17.866ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "800186a0-e7c1-4b13-b269-d04b63b39e35", "content-length": "691", "date": "Wed, 18 Jun 2025 18:51:17 GMT"} })
67602025-06-18T18:51:17.866ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
67612025-06-18T18:51:17.866ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
67622025-06-18T18:51:17.866ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
67632025-06-18T18:51:17.868ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 306.292615ms iteration = 33 status = {}
67642025-06-18T18:51:17.883ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67652025-06-18T18:51:17.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67662025-06-18T18:51:17.886ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 7e1ff921-047f-464e-8081-f8132af716ac, rack_id: 3a330d2e-6212-46a4-9781-374fdb3dc92f, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(6c07c314-d66b-4041-9040-d774200d26a9) } rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
67672025-06-18T18:51:17.886ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67682025-06-18T18:51:17.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 87ad155d-7634-4cad-bf60-51db36e2b7ed roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
67692025-06-18T18:51:17.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67702025-06-18T18:51:17.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 87ad155d-7634-4cad-bf60-51db36e2b7ed resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
67712025-06-18T18:51:17.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1999 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 87ad155d-7634-4cad-bf60-51db36e2b7ed response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
67722025-06-18T18:51:17.899ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
67732025-06-18T18:51:17.899ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 6c07c314-d66b-4041-9040-d774200d26a9
67742025-06-18T18:51:17.899ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
67752025-06-18T18:51:17.899ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
67762025-06-18T18:51:17.899ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67772025-06-18T18:51:17.899ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67782025-06-18T18:51:17.899ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67792025-06-18T18:51:17.899ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67802025-06-18T18:51:17.899ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
67812025-06-18T18:51:17.899ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
67822025-06-18T18:51:17.899ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
67832025-06-18T18:51:17.899ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67842025-06-18T18:51:17.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67852025-06-18T18:51:17.902ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
67862025-06-18T18:51:17.902ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
67872025-06-18T18:51:18.001ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d273756e-7a01-40d6-9466-01a3512f0268", "date": "Wed, 18 Jun 2025 18:51:17 GMT"} })
67882025-06-18T18:51:18.001ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch = Switch0
67892025-06-18T18:51:18.001ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
67902025-06-18T18:51:18.001ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "011f9226-8961-4c87-a049-dcb8ad00e766", "content-length": "682", "date": "Wed, 18 Jun 2025 18:51:17 GMT"} })
67912025-06-18T18:51:18.001ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67922025-06-18T18:51:18.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67932025-06-18T18:51:18.004ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67942025-06-18T18:51:18.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67952025-06-18T18:51:18.008ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67962025-06-18T18:51:18.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67972025-06-18T18:51:18.010ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67982025-06-18T18:51:18.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67992025-06-18T18:51:18.017ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 455.743577ms iteration = 32 status = {}
68002025-06-18T18:51:18.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5055ddd7-0b5d-47be-8df0-9540087b8b53 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68012025-06-18T18:51:18.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5055ddd7-0b5d-47be-8df0-9540087b8b53 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68022025-06-18T18:51:18.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2204 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5055ddd7-0b5d-47be-8df0-9540087b8b53 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68032025-06-18T18:51:19.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 31bb82dd-9d05-4784-9bb0-6c95c5a84292 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68042025-06-18T18:51:19.917ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 31bb82dd-9d05-4784-9bb0-6c95c5a84292 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68052025-06-18T18:51:19.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2381 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 31bb82dd-9d05-4784-9bb0-6c95c5a84292 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68062025-06-18T18:51:20.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a3a29d24-4f33-4690-bbe4-e6ca2ab5aa2c roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68072025-06-18T18:51:20.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a3a29d24-4f33-4690-bbe4-e6ca2ab5aa2c resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68082025-06-18T18:51:20.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2652 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = a3a29d24-4f33-4690-bbe4-e6ca2ab5aa2c response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68092025-06-18T18:51:21.136ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 666 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 6eda489a-0593-43b5-bc00-89476fdc468d response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
68102025-06-18T18:51:21.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e7a20b00-274e-4bc1-b178-84df32cb2044 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68112025-06-18T18:51:21.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e7a20b00-274e-4bc1-b178-84df32cb2044 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68122025-06-18T18:51:21.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2486 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = e7a20b00-274e-4bc1-b178-84df32cb2044 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68132025-06-18T18:51:22.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4776b755-aa98-408c-826e-9f28c7ac1aef roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68142025-06-18T18:51:22.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4776b755-aa98-408c-826e-9f28c7ac1aef resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68152025-06-18T18:51:22.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2114 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4776b755-aa98-408c-826e-9f28c7ac1aef response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68162025-06-18T18:51:23.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cab2bce6-2e3d-44ee-a33f-fc2432d16113 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68172025-06-18T18:51:23.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cab2bce6-2e3d-44ee-a33f-fc2432d16113 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68182025-06-18T18:51:23.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2767 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cab2bce6-2e3d-44ee-a33f-fc2432d16113 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68192025-06-18T18:51:24.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 48a296df-4d0b-45e1-9180-8cacbd89e94a roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68202025-06-18T18:51:24.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 48a296df-4d0b-45e1-9180-8cacbd89e94a resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68212025-06-18T18:51:24.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2367 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 48a296df-4d0b-45e1-9180-8cacbd89e94a response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68222025-06-18T18:51:26.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cab959b8-123a-4756-b591-a149a4801e73 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68232025-06-18T18:51:26.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cab959b8-123a-4756-b591-a149a4801e73 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68242025-06-18T18:51:26.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2508 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cab959b8-123a-4756-b591-a149a4801e73 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68252025-06-18T18:51:27.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 86545893-23c3-43d6-9cfc-46ae49dd1155 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68262025-06-18T18:51:27.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 86545893-23c3-43d6-9cfc-46ae49dd1155 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68272025-06-18T18:51:27.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2297 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 86545893-23c3-43d6-9cfc-46ae49dd1155 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68282025-06-18T18:51:27.561ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 95 reason = Timeout
68292025-06-18T18:51:27.561ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 95 reason = Timeout
68302025-06-18T18:51:27.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68312025-06-18T18:51:27.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68322025-06-18T18:51:27.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68332025-06-18T18:51:27.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68342025-06-18T18:51:27.563ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68352025-06-18T18:51:27.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68362025-06-18T18:51:27.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68372025-06-18T18:51:27.565ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.390411ms iteration = 95 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68382025-06-18T18:51:27.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68392025-06-18T18:51:27.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68402025-06-18T18:51:27.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68412025-06-18T18:51:27.569ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68422025-06-18T18:51:27.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68432025-06-18T18:51:27.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68442025-06-18T18:51:27.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
68452025-06-18T18:51:27.573ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68462025-06-18T18:51:27.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68472025-06-18T18:51:27.583ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
68482025-06-18T18:51:27.583ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.140946ms iteration = 95 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
68492025-06-18T18:51:28.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 73eec299-e177-4db4-b912-f6834452b2e1 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68502025-06-18T18:51:28.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 73eec299-e177-4db4-b912-f6834452b2e1 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68512025-06-18T18:51:28.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2155 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 73eec299-e177-4db4-b912-f6834452b2e1 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68522025-06-18T18:51:29.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 55f17048-fa81-4a01-8abb-974f08c3e319 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68532025-06-18T18:51:29.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 55f17048-fa81-4a01-8abb-974f08c3e319 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68542025-06-18T18:51:29.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2207 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 55f17048-fa81-4a01-8abb-974f08c3e319 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68552025-06-18T18:51:30.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d95a4f53-8712-4da3-9453-307b98e16753 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68562025-06-18T18:51:30.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d95a4f53-8712-4da3-9453-307b98e16753 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68572025-06-18T18:51:30.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2069 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d95a4f53-8712-4da3-9453-307b98e16753 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68582025-06-18T18:51:31.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6df8a5aa-a4af-45ec-a170-d4d500ddeae2 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68592025-06-18T18:51:31.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6df8a5aa-a4af-45ec-a170-d4d500ddeae2 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68602025-06-18T18:51:31.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2604 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6df8a5aa-a4af-45ec-a170-d4d500ddeae2 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68612025-06-18T18:51:31.136ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 520 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 1bf3ede5-280c-4844-876e-7cae719f46a1 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
68622025-06-18T18:51:32.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cb9eedf0-fd60-4321-bc72-797d9cb40504 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68632025-06-18T18:51:32.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cb9eedf0-fd60-4321-bc72-797d9cb40504 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68642025-06-18T18:51:32.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2291 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = cb9eedf0-fd60-4321-bc72-797d9cb40504 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68652025-06-18T18:51:33.124ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 23c037d9-573c-43d4-a32f-6d2b5c79d188 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68662025-06-18T18:51:33.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 23c037d9-573c-43d4-a32f-6d2b5c79d188 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68672025-06-18T18:51:33.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 4073 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 23c037d9-573c-43d4-a32f-6d2b5c79d188 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68682025-06-18T18:51:34.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 411f14ed-07c8-48cb-8149-09fab0de0b30 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68692025-06-18T18:51:34.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 411f14ed-07c8-48cb-8149-09fab0de0b30 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68702025-06-18T18:51:34.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3012 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 411f14ed-07c8-48cb-8149-09fab0de0b30 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68712025-06-18T18:51:35.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 53a4cb82-554f-4f07-8493-631a404dff5f roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68722025-06-18T18:51:35.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 53a4cb82-554f-4f07-8493-631a404dff5f resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68732025-06-18T18:51:35.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2181 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 53a4cb82-554f-4f07-8493-631a404dff5f response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68742025-06-18T18:51:36.127ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:51600
68752025-06-18T18:51:36.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51600 req_id = f73964fb-3330-4370-8714-d2c39eb8f931 roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
68762025-06-18T18:51:36.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51600 req_id = f73964fb-3330-4370-8714-d2c39eb8f931 resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
68772025-06-18T18:51:36.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3394 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51600 req_id = f73964fb-3330-4370-8714-d2c39eb8f931 response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?sort_by=id_ascending
68782025-06-18T18:51:36.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51600 req_id = b2dce19b-8da8-4388-aac3-731d352e67f3 roles = RoleSet { roles: {} } uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
68792025-06-18T18:51:36.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51600 req_id = b2dce19b-8da8-4388-aac3-731d352e67f3 resource = Database result = Ok(()) uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
68802025-06-18T18:51:36.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2768 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:51600 req_id = b2dce19b-8da8-4388-aac3-731d352e67f3 response_code = 200 uri = /metrics/collectors/c88bda47-97a6-468e-bf39-3fffe994d639/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiZDY1MDM4MS0yZWMyLTQyYjctOWU5NC01ZmRhMzdkOTUxYjgifX0%3D
68812025-06-18T18:51:36.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bda9099c-a5d7-4794-a114-ed787a48e716 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68822025-06-18T18:51:36.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bda9099c-a5d7-4794-a114-ed787a48e716 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68832025-06-18T18:51:36.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2807 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bda9099c-a5d7-4794-a114-ed787a48e716 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68842025-06-18T18:51:37.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 644470a5-eee3-4212-9e2f-b4d7d24512c9 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68852025-06-18T18:51:37.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 644470a5-eee3-4212-9e2f-b4d7d24512c9 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68862025-06-18T18:51:37.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2372 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 644470a5-eee3-4212-9e2f-b4d7d24512c9 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
68872025-06-18T18:51:37.561ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 96 reason = Timeout
68882025-06-18T18:51:37.561ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68892025-06-18T18:51:37.561ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 96 reason = Timeout
68902025-06-18T18:51:37.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68912025-06-18T18:51:37.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68922025-06-18T18:51:37.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68932025-06-18T18:51:37.564ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68942025-06-18T18:51:37.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68952025-06-18T18:51:37.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68962025-06-18T18:51:37.565ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.775523ms iteration = 96 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68972025-06-18T18:51:37.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68982025-06-18T18:51:37.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68992025-06-18T18:51:37.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69002025-06-18T18:51:37.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69012025-06-18T18:51:37.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69022025-06-18T18:51:37.571ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69032025-06-18T18:51:37.574ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
69042025-06-18T18:51:37.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69052025-06-18T18:51:37.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69062025-06-18T18:51:37.585ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
69072025-06-18T18:51:37.585ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.941101ms iteration = 96 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
69082025-06-18T18:51:38.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 70e3ccc1-b77d-42a0-947a-376d18e7b53c roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69092025-06-18T18:51:38.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 70e3ccc1-b77d-42a0-947a-376d18e7b53c resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69102025-06-18T18:51:38.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2409 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 70e3ccc1-b77d-42a0-947a-376d18e7b53c response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69112025-06-18T18:51:39.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bd1d8af0-46b9-4616-ae0a-f7ca8e8f0d3b roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69122025-06-18T18:51:39.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bd1d8af0-46b9-4616-ae0a-f7ca8e8f0d3b resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69132025-06-18T18:51:39.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2160 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = bd1d8af0-46b9-4616-ae0a-f7ca8e8f0d3b response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69142025-06-18T18:51:40.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7398841d-43d7-4857-a591-698e60469fa1 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69152025-06-18T18:51:40.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7398841d-43d7-4857-a591-698e60469fa1 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69162025-06-18T18:51:40.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2448 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7398841d-43d7-4857-a591-698e60469fa1 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69172025-06-18T18:51:41.136ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 646 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = ddd409f4-8057-4dac-bff4-736bfe5ae696 response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
69182025-06-18T18:51:41.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6a500bdc-323b-4f54-bcf6-b97714e15712 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69192025-06-18T18:51:41.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6a500bdc-323b-4f54-bcf6-b97714e15712 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69202025-06-18T18:51:41.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2470 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6a500bdc-323b-4f54-bcf6-b97714e15712 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69212025-06-18T18:51:42.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f1a62bb2-5c46-4a2b-9c65-96a6a96b5c07 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69222025-06-18T18:51:42.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f1a62bb2-5c46-4a2b-9c65-96a6a96b5c07 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69232025-06-18T18:51:42.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2829 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f1a62bb2-5c46-4a2b-9c65-96a6a96b5c07 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69242025-06-18T18:51:43.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4f0bec7d-c3b7-4c4d-9bd8-26d71a20c71a roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69252025-06-18T18:51:43.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4f0bec7d-c3b7-4c4d-9bd8-26d71a20c71a resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69262025-06-18T18:51:43.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2294 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 4f0bec7d-c3b7-4c4d-9bd8-26d71a20c71a response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69272025-06-18T18:51:44.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6c572978-e339-487f-9b51-d3660c79a933 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69282025-06-18T18:51:44.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6c572978-e339-487f-9b51-d3660c79a933 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69292025-06-18T18:51:44.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1852 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 6c572978-e339-487f-9b51-d3660c79a933 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69302025-06-18T18:51:45.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f2688ca0-70a8-4498-8b6c-4edb5ff230f1 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69312025-06-18T18:51:45.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f2688ca0-70a8-4498-8b6c-4edb5ff230f1 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69322025-06-18T18:51:45.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2412 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f2688ca0-70a8-4498-8b6c-4edb5ff230f1 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69332025-06-18T18:51:46.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8742fe04-8416-4ee4-97da-8ba1e3211b82 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69342025-06-18T18:51:46.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8742fe04-8416-4ee4-97da-8ba1e3211b82 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69352025-06-18T18:51:46.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2756 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 8742fe04-8416-4ee4-97da-8ba1e3211b82 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69362025-06-18T18:51:47.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b6a5381c-0cf5-4f34-968f-84d81592d2fb roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69372025-06-18T18:51:47.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b6a5381c-0cf5-4f34-968f-84d81592d2fb resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69382025-06-18T18:51:47.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2328 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = b6a5381c-0cf5-4f34-968f-84d81592d2fb response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
69392025-06-18T18:51:47.562ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 97 reason = Timeout
69402025-06-18T18:51:47.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69412025-06-18T18:51:47.562ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 33 reason = Timeout
69422025-06-18T18:51:47.562ZDEBGnexus (BackgroundTasks): activating background_task = alert_dispatcher iteration = 17 reason = Timeout
69432025-06-18T18:51:47.562ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
69442025-06-18T18:51:47.562ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
69452025-06-18T18:51:47.562ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 17 reason = Timeout
69462025-06-18T18:51:47.562ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
69472025-06-18T18:51:47.562ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 36 reason = Timeout
69482025-06-18T18:51:47.562ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69492025-06-18T18:51:47.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
69502025-06-18T18:51:47.562ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 18 reason = Timeout
69512025-06-18T18:51:47.562ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe
69522025-06-18T18:51:47.562ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 7.97\u{b5}s iteration = 18 status = {"enabled":false,"target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe"}
69532025-06-18T18:51:47.562ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 17 reason = Timeout
69542025-06-18T18:51:47.562ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 17 reason = Timeout
69552025-06-18T18:51:47.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69562025-06-18T18:51:47.562ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
69572025-06-18T18:51:47.562ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 33 reason = Timeout
69582025-06-18T18:51:47.562ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69592025-06-18T18:51:47.562ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
69602025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 17 reason = Timeout
69612025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 17 reason = Timeout
69622025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 19 reason = Timeout
69632025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
69642025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 17 reason = Timeout
69652025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
69662025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 17 reason = Timeout
69672025-06-18T18:51:47.563ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
69682025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
69692025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 19 reason = Timeout
69702025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
69712025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 34 reason = Timeout
69722025-06-18T18:51:47.563ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
69732025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 33 reason = Timeout
69742025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69752025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
69762025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 33 reason = Timeout
69772025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69782025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 34 reason = Timeout
69792025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
69802025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69812025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 33 reason = Timeout
69822025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69832025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 33 reason = Timeout
69842025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69852025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 33 reason = Timeout
69862025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
69872025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69882025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 97 reason = Timeout
69892025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 17 reason = Timeout
69902025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69912025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
69922025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
69932025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 34 reason = Timeout
69942025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69952025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 33 reason = Timeout
69962025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
69972025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 33 reason = Timeout
69982025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 33 reason = Timeout
69992025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
70002025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70012025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 33 reason = Timeout
70022025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70032025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 33 reason = Timeout
70042025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
70052025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 33 reason = Timeout
70062025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70072025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
70082025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 17 reason = Timeout
70092025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 17 reason = Timeout
70102025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
70112025-06-18T18:51:47.563ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-06-18 18:41:47.563401941 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
70122025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
70132025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
70142025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 17 reason = Timeout
70152025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
70162025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70172025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70182025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
70192025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70202025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70212025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70222025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70232025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70242025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70252025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
70262025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70272025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70282025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
70292025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70302025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70312025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
70322025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
70332025-06-18T18:51:47.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70342025-06-18T18:51:47.563ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("03fce462-e4e1-4a86-890b-8a2ae9e17168.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("800703b5-0601-4ce2-acc3-d5b9ca473160.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("800703b5-0601-4ce2-acc3-d5b9ca473160.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1897, tv_nsec: 141061509 } })
70352025-06-18T18:51:47.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70362025-06-18T18:51:47.564ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("51411444-5ad0-46e8-b345-7ee26fb32a60.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("adea75c9-2ff2-4f9f-bfac-48c7702333e0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ea7c6eed-68db-4cd0-929a-17b08777d263.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ea7c6eed-68db-4cd0-929a-17b08777d263.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1897, tv_nsec: 141092650 } })
70372025-06-18T18:51:47.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
70382025-06-18T18:51:47.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
70392025-06-18T18:51:47.564ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
70402025-06-18T18:51:47.564ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
70412025-06-18T18:51:47.564ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.655633ms iteration = 17 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
70422025-06-18T18:51:47.564ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.720854ms iteration = 17 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
70432025-06-18T18:51:47.565ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70442025-06-18T18:51:47.566ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70452025-06-18T18:51:47.568ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.08198ms iteration = 33 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
70462025-06-18T18:51:47.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70472025-06-18T18:51:47.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70482025-06-18T18:51:47.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70492025-06-18T18:51:47.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70502025-06-18T18:51:47.568ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70512025-06-18T18:51:47.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70522025-06-18T18:51:47.570ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70532025-06-18T18:51:47.573ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 10.928971ms iteration = 33 status = {"errors":[],"requests_created_ok":[]}
70542025-06-18T18:51:47.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
70552025-06-18T18:51:47.573ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:202 num_receivers = 0
70562025-06-18T18:51:47.573ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
70572025-06-18T18:51:47.573ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 10.988422ms iteration = 17 status = {"by_rx":{},"error":null}
70582025-06-18T18:51:47.573ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70592025-06-18T18:51:47.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
70602025-06-18T18:51:47.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70612025-06-18T18:51:47.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70622025-06-18T18:51:47.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70632025-06-18T18:51:47.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70642025-06-18T18:51:47.575ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70652025-06-18T18:51:47.576ZDEBGnexus (BackgroundTasks): roles background_task = alert_dispatcher roles = RoleSet { roles: {} }
70662025-06-18T18:51:47.576ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70672025-06-18T18:51:47.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = alert_dispatcher resource = Database result = Ok(())
70682025-06-18T18:51:47.578ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70692025-06-18T18:51:47.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70702025-06-18T18:51:47.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70712025-06-18T18:51:47.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
70722025-06-18T18:51:47.579ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
70732025-06-18T18:51:47.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
70742025-06-18T18:51:47.580ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70752025-06-18T18:51:47.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
70762025-06-18T18:51:47.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70772025-06-18T18:51:47.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70782025-06-18T18:51:47.582ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
70792025-06-18T18:51:47.582ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70802025-06-18T18:51:47.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70812025-06-18T18:51:47.583ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1897, tv_nsec: 160106392 } })
70822025-06-18T18:51:47.583ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1179
70832025-06-18T18:51:47.584ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-06-18 18:41:47.563401941 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
70842025-06-18T18:51:47.584ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 21.254984ms iteration = 17 status = {"expiration":"2025-06-18T18:41:47.563401941Z","pruned":[]}
70852025-06-18T18:51:47.584ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70862025-06-18T18:51:47.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
70872025-06-18T18:51:47.587ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70882025-06-18T18:51:47.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70892025-06-18T18:51:47.591ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1897, tv_nsec: 168446027 } })
70902025-06-18T18:51:47.591ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1179
70912025-06-18T18:51:47.591ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70922025-06-18T18:51:47.593ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 29.996104ms iteration = 17 status = {"errors":[],"found_port_ok":[]}
70932025-06-18T18:51:47.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
70942025-06-18T18:51:47.594ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70952025-06-18T18:51:47.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
70962025-06-18T18:51:47.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70972025-06-18T18:51:47.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70982025-06-18T18:51:47.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70992025-06-18T18:51:47.597ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71002025-06-18T18:51:47.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71012025-06-18T18:51:47.599ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71022025-06-18T18:51:47.599ZDEBGnexus (BackgroundTasks): activation complete background_task = alert_dispatcher elapsed = 36.854299ms iteration = 17 status = {"dispatched":[],"errors":[],"glob_version":"150.0.0","globs_reprocessed":{},"no_receivers":[]}
71032025-06-18T18:51:47.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71042025-06-18T18:51:47.603ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71052025-06-18T18:51:47.603ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71062025-06-18T18:51:47.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71072025-06-18T18:51:47.606ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71082025-06-18T18:51:47.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71092025-06-18T18:51:47.606ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71102025-06-18T18:51:47.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71112025-06-18T18:51:47.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9fbbc826-5b83-4b80-8172-66302c618aae.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1897, tv_nsec: 184707941 } })
71122025-06-18T18:51:47.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1179 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
71132025-06-18T18:51:47.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71142025-06-18T18:51:47.609ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71152025-06-18T18:51:47.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
71162025-06-18T18:51:47.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71172025-06-18T18:51:47.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71182025-06-18T18:51:47.612ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71192025-06-18T18:51:47.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71202025-06-18T18:51:47.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71212025-06-18T18:51:47.614ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71222025-06-18T18:51:47.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71232025-06-18T18:51:47.632ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 69.325777ms iteration = 33 status = {"errors":[],"garbage_collect_requested":[]}
71242025-06-18T18:51:47.633ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71252025-06-18T18:51:47.633ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
71262025-06-18T18:51:47.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71272025-06-18T18:51:47.633ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71282025-06-18T18:51:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71292025-06-18T18:51:47.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71302025-06-18T18:51:47.637ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
71312025-06-18T18:51:47.638ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
71322025-06-18T18:51:47.638ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 74.548328ms iteration = 17 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
71332025-06-18T18:51:47.639ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 76.593737ms iteration = 97 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71342025-06-18T18:51:47.644ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 81.049398ms iteration = 33 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71352025-06-18T18:51:47.644ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71362025-06-18T18:51:47.644ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
71372025-06-18T18:51:47.644ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71382025-06-18T18:51:47.645ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
71392025-06-18T18:51:47.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71402025-06-18T18:51:47.645ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71412025-06-18T18:51:47.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
71422025-06-18T18:51:47.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71432025-06-18T18:51:47.645ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71442025-06-18T18:51:47.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71452025-06-18T18:51:47.646ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 82.854483ms iteration = 33 status = {"errors":[],"finish_invoked_ok":[]}
71462025-06-18T18:51:47.647ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71472025-06-18T18:51:47.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
71482025-06-18T18:51:47.650ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
71492025-06-18T18:51:47.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
71502025-06-18T18:51:47.654ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71512025-06-18T18:51:47.657ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
71522025-06-18T18:51:47.657ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 95.373556ms iteration = 97 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
71532025-06-18T18:51:47.658ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
71542025-06-18T18:51:47.658ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
71552025-06-18T18:51:47.658ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 95.754111ms iteration = 17 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
71562025-06-18T18:51:47.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71572025-06-18T18:51:47.660ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
71582025-06-18T18:51:47.660ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
71592025-06-18T18:51:47.661ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
71602025-06-18T18:51:47.661ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71612025-06-18T18:51:47.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71622025-06-18T18:51:47.663ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71632025-06-18T18:51:47.663ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71642025-06-18T18:51:47.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71652025-06-18T18:51:47.665ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71662025-06-18T18:51:47.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71672025-06-18T18:51:47.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
71682025-06-18T18:51:47.666ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71692025-06-18T18:51:47.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71702025-06-18T18:51:47.668ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71712025-06-18T18:51:47.669ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
71722025-06-18T18:51:47.669ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 106.380268ms iteration = 33 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
71732025-06-18T18:51:47.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9fbbc826-5b83-4b80-8172-66302c618aae, lookup_type: ById(9fbbc826-5b83-4b80-8172-66302c618aae) } result = Ok(())
71742025-06-18T18:51:47.673ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71752025-06-18T18:51:47.673ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
71762025-06-18T18:51:47.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71772025-06-18T18:51:47.675ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71782025-06-18T18:51:47.675ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 112.799786ms iteration = 33 status = 0
71792025-06-18T18:51:47.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
71802025-06-18T18:51:47.678ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71812025-06-18T18:51:47.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71822025-06-18T18:51:47.680ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 117.610203ms iteration = 33 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71832025-06-18T18:51:47.681ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71842025-06-18T18:51:47.681ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
71852025-06-18T18:51:47.681ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 118.823839ms iteration = 34 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
71862025-06-18T18:51:47.693ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 130.881555ms iteration = 36 status = {"physical_disks_added":0}
71872025-06-18T18:51:47.693ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
71882025-06-18T18:51:47.693ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
71892025-06-18T18:51:47.693ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
71902025-06-18T18:51:47.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71912025-06-18T18:51:47.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71922025-06-18T18:51:47.694ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:372
71932025-06-18T18:51:47.694ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 131.607885ms iteration = 33 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
71942025-06-18T18:51:47.695ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71952025-06-18T18:51:47.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71962025-06-18T18:51:47.698ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71972025-06-18T18:51:47.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71982025-06-18T18:51:47.699ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71992025-06-18T18:51:47.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72002025-06-18T18:51:47.708ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
72012025-06-18T18:51:47.708ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = ab8dd933-5e45-404d-97a3-fdafa1c7d91b dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
72022025-06-18T18:51:47.708ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72032025-06-18T18:51:47.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72042025-06-18T18:51:47.709ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
72052025-06-18T18:51:47.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
72062025-06-18T18:51:47.709ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72072025-06-18T18:51:47.713ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72082025-06-18T18:51:47.713ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72092025-06-18T18:51:47.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72102025-06-18T18:51:47.716ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = ab8dd933-5e45-404d-97a3-fdafa1c7d91b dns_zone_name = control-plane.oxide.internal found_so_far = 59 version = 1
72112025-06-18T18:51:47.716ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
72122025-06-18T18:51:47.716ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-06-18 18:36:19.303122 UTC dns_group = internal generation = 1
72132025-06-18T18:51:47.716ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 152.91409ms iteration = 17 status = {"generation":1}
72142025-06-18T18:51:47.716ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72152025-06-18T18:51:47.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72162025-06-18T18:51:47.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72172025-06-18T18:51:47.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72182025-06-18T18:51:47.733ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
72192025-06-18T18:51:47.733ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 72dd4529-6655-4d30-a1d8-0de429d0133c dns_zone_name = oxide.test found_so_far = 0 version = 2
72202025-06-18T18:51:47.733ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72212025-06-18T18:51:47.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72222025-06-18T18:51:47.733ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 170.501852ms iteration = 33 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
72232025-06-18T18:51:47.746ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
72242025-06-18T18:51:47.747ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72252025-06-18T18:51:47.747ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "afa5744a-be1c-43ec-8e38-86fe55215202", "content-length": "26", "date": "Wed, 18 Jun 2025 18:51:47 GMT"} })
72262025-06-18T18:51:47.747ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72272025-06-18T18:51:47.748ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72282025-06-18T18:51:47.761ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1187 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f zone_address = fd00:1122:3344:101::2
72292025-06-18T18:51:47.761ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72302025-06-18T18:51:47.762ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8bc59400-fa9b-4938-9346-f06214cbbc06", "content-length": "26", "date": "Wed, 18 Jun 2025 18:51:47 GMT"} })
72312025-06-18T18:51:47.762ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1190 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72322025-06-18T18:51:47.763ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
72332025-06-18T18:51:47.768ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
72342025-06-18T18:51:47.827ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
72352025-06-18T18:51:47.827ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "fda8d53f-0f4f-43f4-bbd2-f462e69b3699", "date": "Wed, 18 Jun 2025 18:51:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72362025-06-18T18:51:47.827ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72372025-06-18T18:51:47.829ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "612e0ebe-3e39-46e2-afac-fd1f2837df76", "date": "Wed, 18 Jun 2025 18:51:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72382025-06-18T18:51:47.829ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72392025-06-18T18:51:47.830ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
72402025-06-18T18:51:47.830ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 267.997438ms iteration = 19 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
72412025-06-18T18:51:47.836ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
72422025-06-18T18:51:47.836ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 273.668406ms iteration = 17 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
72432025-06-18T18:51:47.858ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
72442025-06-18T18:51:47.858ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72452025-06-18T18:51:47.858ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f70eff6-81e0-43ce-af18-bb4f9cb3db84", "content-length": "372", "date": "Wed, 18 Jun 2025 18:51:47 GMT"} })
72462025-06-18T18:51:47.858ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72472025-06-18T18:51:47.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72482025-06-18T18:51:47.860ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72492025-06-18T18:51:47.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72502025-06-18T18:51:47.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
72512025-06-18T18:51:47.863ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72522025-06-18T18:51:47.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72532025-06-18T18:51:47.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72542025-06-18T18:51:47.864ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72552025-06-18T18:51:47.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72562025-06-18T18:51:47.865ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1187 zone_address = fd00:1122:3344:101::2
72572025-06-18T18:51:47.865ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72582025-06-18T18:51:47.866ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbc87a95-5c7e-49c1-8013-5886bf9b4559", "content-length": "26", "date": "Wed, 18 Jun 2025 18:51:47 GMT"} })
72592025-06-18T18:51:47.866ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1190 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72602025-06-18T18:51:47.866ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 72dd4529-6655-4d30-a1d8-0de429d0133c dns_zone_name = oxide.test found_so_far = 4 version = 2
72612025-06-18T18:51:47.866ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
72622025-06-18T18:51:47.866ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-06-18 18:36:20.010620 UTC dns_group = external generation = 2
72632025-06-18T18:51:47.866ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 303.469487ms iteration = 17 status = {"generation":2}
72642025-06-18T18:51:47.868ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1224 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72652025-06-18T18:51:47.892ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 329.598507ms iteration = 33 status = {}
72662025-06-18T18:51:47.909ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-06-18T18:35:46.206089Z, time_modified: 2025-06-18T18:35:46.206089Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 472c0288-095b-456c-b18f-d5f22a8efd72, db_silo: Silo { identity: SiloIdentity { id: 472c0288-095b-456c-b18f-d5f22a8efd72, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-18T18:36:19.955323Z, time_modified: 2025-06-18T18:36:19.955323Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 472c0288-095b-456c-b18f-d5f22a8efd72, db_silo: Silo { identity: SiloIdentity { id: 472c0288-095b-456c-b18f-d5f22a8efd72, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-06-18T18:36:19.955323Z, time_modified: 2025-06-18T18:36:19.955323Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3" }] }) }
72672025-06-18T18:51:47.909ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 347.116509ms iteration = 17 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"472c0288-095b-456c-b18f-d5f22a8efd72","tls_certs":["6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3"]}},"default_endpoint":{"silo_id":"472c0288-095b-456c-b18f-d5f22a8efd72","tls_certs":["6303c72c7e69449e771caf7c2904614871b85dba11817077c36119b797c778e3"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
72682025-06-18T18:51:47.913ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
72692025-06-18T18:51:47.913ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
72702025-06-18T18:51:47.913ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "11138347-af0a-4410-811b-f1464a45cbc7", "date": "Wed, 18 Jun 2025 18:51:47 GMT"} })
72712025-06-18T18:51:47.913ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72722025-06-18T18:51:47.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72732025-06-18T18:51:47.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72742025-06-18T18:51:47.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72752025-06-18T18:51:47.918ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72762025-06-18T18:51:47.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72772025-06-18T18:51:47.921ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
72782025-06-18T18:51:47.922ZINFOnexus (BackgroundTasks): VPC route manager sled 9fbbc826-5b83-4b80-8172-66302c618aae push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
72792025-06-18T18:51:47.922ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72802025-06-18T18:51:47.922ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cfb8f832-bab3-4092-8a8c-7500fb237873", "date": "Wed, 18 Jun 2025 18:51:47 GMT"} })
72812025-06-18T18:51:47.924ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 361.531888ms iteration = 34 status = {}
72822025-06-18T18:51:47.949ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72832025-06-18T18:51:47.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72842025-06-18T18:51:47.952ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 389.181519ms iteration = 33 status = null
72852025-06-18T18:51:47.967ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72862025-06-18T18:51:47.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72872025-06-18T18:51:47.969ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72882025-06-18T18:51:47.971ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72892025-06-18T18:51:47.971ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72902025-06-18T18:51:47.971ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
72912025-06-18T18:51:47.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72922025-06-18T18:51:47.972ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3982068f-7a97-4c46-b805-96253f542fd1", "date": "Wed, 18 Jun 2025 18:51:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
72932025-06-18T18:51:47.972ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
72942025-06-18T18:51:47.972ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72952025-06-18T18:51:47.973ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "be56dd06-7e14-4458-b161-dcb9b8069c44", "date": "Wed, 18 Jun 2025 18:51:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
72962025-06-18T18:51:47.973ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
72972025-06-18T18:51:47.974ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72982025-06-18T18:51:47.974ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72992025-06-18T18:51:47.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73002025-06-18T18:51:47.975ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f1bdd088-3bd5-4018-8776-aa997457b32b", "date": "Wed, 18 Jun 2025 18:51:47 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
73012025-06-18T18:51:47.975ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
73022025-06-18T18:51:47.978ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
73032025-06-18T18:51:47.978ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 415.30095ms iteration = 19 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
73042025-06-18T18:51:47.993ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73052025-06-18T18:51:47.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73062025-06-18T18:51:47.994ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 7e1ff921-047f-464e-8081-f8132af716ac, rack_id: 3a330d2e-6212-46a4-9781-374fdb3dc92f, switch_location: "switch0", port_name: Name(Name("qsfp0")), port_settings_id: Some(6c07c314-d66b-4041-9040-d774200d26a9) } rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
73072025-06-18T18:51:47.994ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73082025-06-18T18:51:47.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73092025-06-18T18:51:48.008ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1832 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = Name(Name("qsfp0"))
73102025-06-18T18:51:48.008ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1859 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0 switch_port_id = Name(Name("qsfp0")) switch_port_settings_id = 6c07c314-d66b-4041-9040-d774200d26a9
73112025-06-18T18:51:48.008ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
73122025-06-18T18:51:48.008ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
73132025-06-18T18:51:48.008ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73142025-06-18T18:51:48.008ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73152025-06-18T18:51:48.008ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73162025-06-18T18:51:48.008ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2006 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
73172025-06-18T18:51:48.008ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73182025-06-18T18:51:48.008ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2042 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
73192025-06-18T18:51:48.009ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f
73202025-06-18T18:51:48.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73212025-06-18T18:51:48.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73222025-06-18T18:51:48.012ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch_location = Switch0
73232025-06-18T18:51:48.012ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
73242025-06-18T18:51:48.077ZDEBGnexus (BackgroundTasks): client request SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
73252025-06-18T18:51:48.113ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "37b15bbc-df7f-4794-ad9f-3d17a7a38a86", "date": "Wed, 18 Jun 2025 18:51:47 GMT"} })
73262025-06-18T18:51:48.113ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f switch = Switch0
73272025-06-18T18:51:48.113ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
73282025-06-18T18:51:48.114ZDEBGnexus (BackgroundTasks): client response SledAgent = 9fbbc826-5b83-4b80-8172-66302c618aae background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f982012b-f0de-4ad7-9ab6-a4d7aa850482", "content-length": "691", "date": "Wed, 18 Jun 2025 18:51:47 GMT"} })
73292025-06-18T18:51:48.114ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
73302025-06-18T18:51:48.114ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
73312025-06-18T18:51:48.114ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
73322025-06-18T18:51:48.114ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 3a330d2e-6212-46a4-9781-374fdb3dc92f result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6abb245c-87b8-4545-abdd-6ec024e486d2", "content-length": "682", "date": "Wed, 18 Jun 2025 18:51:48 GMT"} })
73332025-06-18T18:51:48.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73342025-06-18T18:51:48.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73352025-06-18T18:51:48.115ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 552.046556ms iteration = 34 status = {}
73362025-06-18T18:51:48.118ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73372025-06-18T18:51:48.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73382025-06-18T18:51:48.122ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73392025-06-18T18:51:48.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73402025-06-18T18:51:48.124ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73412025-06-18T18:51:48.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73422025-06-18T18:51:48.131ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 568.505663ms iteration = 33 status = {}
73432025-06-18T18:51:48.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f478a366-5ed5-4357-8e28-430d92808e43 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73442025-06-18T18:51:48.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f478a366-5ed5-4357-8e28-430d92808e43 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73452025-06-18T18:51:48.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2976 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = f478a366-5ed5-4357-8e28-430d92808e43 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73462025-06-18T18:51:48.747ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 6
73472025-06-18T18:51:48.747ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::a]:12221
73482025-06-18T18:51:48.779ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
73492025-06-18T18:51:48.779ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:40413
73502025-06-18T18:51:48.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:40413 req_id = 7f8d905e-880c-457e-b9d7-7d3ff1195449 roles = RoleSet { roles: {} } uri = /metrics/producers
73512025-06-18T18:51:48.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:40413 req_id = 7f8d905e-880c-457e-b9d7-7d3ff1195449 resource = Database result = Ok(()) uri = /metrics/producers
73522025-06-18T18:51:48.832ZINFOnexus: assigned collector to new producer collector_id = c88bda47-97a6-468e-bf39-3fffe994d639 file = nexus/src/app/oximeter.rs:76 producer_id = bc9fb17d-ee0d-4316-a104-8c90282fc043
73532025-06-18T18:51:48.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 53544 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:40413 req_id = 7f8d905e-880c-457e-b9d7-7d3ff1195449 response_code = 201 uri = /metrics/producers
73542025-06-18T18:51:48.832ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "7f8d905e-880c-457e-b9d7-7d3ff1195449", "content-length": "41", "date": "Wed, 18 Jun 2025 18:51:48 GMT"} })
73552025-06-18T18:51:48.834ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
73562025-06-18T18:51:49.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d03aa847-c4ef-404d-bbf1-3fedeb527633 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73572025-06-18T18:51:49.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d03aa847-c4ef-404d-bbf1-3fedeb527633 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73582025-06-18T18:51:49.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2359 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = d03aa847-c4ef-404d-bbf1-3fedeb527633 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73592025-06-18T18:51:50.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7a3e5467-db0a-4f3d-8cbd-d3d27ecfdc3f roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73602025-06-18T18:51:50.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7a3e5467-db0a-4f3d-8cbd-d3d27ecfdc3f resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73612025-06-18T18:51:50.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2423 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 7a3e5467-db0a-4f3d-8cbd-d3d27ecfdc3f response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73622025-06-18T18:51:51.136ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 667 local_addr = [fd00:1122:3344:101::a]:56247 method = GET remote_addr = [fd00:1122:3344:101::d]:41599 req_id = 035c4fd5-9380-411f-abe4-73f7d3e4145f response_code = 200 uri = /bc9fb17d-ee0d-4316-a104-8c90282fc043
73632025-06-18T18:51:51.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1f1abee7-8ff1-4676-90f0-92d41d95b55b roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73642025-06-18T18:51:51.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1f1abee7-8ff1-4676-90f0-92d41d95b55b resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73652025-06-18T18:51:51.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3249 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 1f1abee7-8ff1-4676-90f0-92d41d95b55b response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73662025-06-18T18:51:52.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 023ca329-0cd4-4c48-aafc-bc09a11ee3ec roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73672025-06-18T18:51:52.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 023ca329-0cd4-4c48-aafc-bc09a11ee3ec resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73682025-06-18T18:51:52.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2741 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 023ca329-0cd4-4c48-aafc-bc09a11ee3ec response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73692025-06-18T18:51:53.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0192d1fa-a90b-471d-8338-ac1a3bc98cda roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73702025-06-18T18:51:53.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0192d1fa-a90b-471d-8338-ac1a3bc98cda resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73712025-06-18T18:51:53.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2341 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0192d1fa-a90b-471d-8338-ac1a3bc98cda response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73722025-06-18T18:51:54.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 67836400-b026-48cf-afe2-c8e2a70bc5c6 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73732025-06-18T18:51:54.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 67836400-b026-48cf-afe2-c8e2a70bc5c6 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73742025-06-18T18:51:54.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2525 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 67836400-b026-48cf-afe2-c8e2a70bc5c6 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73752025-06-18T18:51:55.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 879d6bc6-c80f-4757-b3f1-9e7d34e20021 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73762025-06-18T18:51:55.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 879d6bc6-c80f-4757-b3f1-9e7d34e20021 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73772025-06-18T18:51:55.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2781 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 879d6bc6-c80f-4757-b3f1-9e7d34e20021 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73782025-06-18T18:51:56.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5a4d9c70-4212-4241-84c1-7d3736291e6b roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73792025-06-18T18:51:56.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5a4d9c70-4212-4241-84c1-7d3736291e6b resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73802025-06-18T18:51:56.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2508 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 5a4d9c70-4212-4241-84c1-7d3736291e6b response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73812025-06-18T18:51:57.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 22e2f96c-b326-44f8-be75-960cde92d79a roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73822025-06-18T18:51:57.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 22e2f96c-b326-44f8-be75-960cde92d79a resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73832025-06-18T18:51:57.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2388 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 22e2f96c-b326-44f8-be75-960cde92d79a response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
73842025-06-18T18:51:57.562ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 98 reason = Timeout
73852025-06-18T18:51:57.562ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 98 reason = Timeout
73862025-06-18T18:51:57.562ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73872025-06-18T18:51:57.562ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73882025-06-18T18:51:57.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73892025-06-18T18:51:57.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73902025-06-18T18:51:57.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73912025-06-18T18:51:57.565ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73922025-06-18T18:51:57.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73932025-06-18T18:51:57.567ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73942025-06-18T18:51:57.567ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73952025-06-18T18:51:57.567ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.740895ms iteration = 98 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73962025-06-18T18:51:57.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73972025-06-18T18:51:57.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73982025-06-18T18:51:57.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73992025-06-18T18:51:57.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74002025-06-18T18:51:57.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe, lookup_type: ById(f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe) } result = Ok(())
74012025-06-18T18:51:57.573ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74022025-06-18T18:51:57.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74032025-06-18T18:51:57.582ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe original_time_created = 2025-06-18 18:35:45.832359 UTC target_id = f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe time_created = 2025-06-18 18:35:45.832359 UTC
74042025-06-18T18:51:57.582ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.792083ms iteration = 98 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"f9c4f55b-7966-4bf3-8cfd-dcc0a77e7dbe","time_created":"2025-06-18T18:35:45.832359Z"}
74052025-06-18T18:51:58.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0a1a1409-01fb-4277-8496-8a2467214206 roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
74062025-06-18T18:51:58.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0a1a1409-01fb-4277-8496-8a2467214206 resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
74072025-06-18T18:51:58.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2502 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = 0a1a1409-01fb-4277-8496-8a2467214206 response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
74082025-06-18T18:51:59.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = abbffdf3-8265-46d6-8325-d863e67dcbed roles = RoleSet { roles: {} } uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
74092025-06-18T18:51:59.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = abbffdf3-8265-46d6-8325-d863e67dcbed resource = Database result = Ok(()) uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae
74102025-06-18T18:51:59.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2146 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36410 req_id = abbffdf3-8265-46d6-8325-d863e67dcbed response_code = 200 uri = /probes/9fbbc826-5b83-4b80-8172-66302c618aae